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Executive Summary 



The Texas Teacher Test 

Purpose of the Research 

The TEC AT, the Texas Exaoiination of Current Administrators and Teach- 
ers, is a basic literacy test that was administered to 202,000 practicing educators in 
March 1986. An in-depth case study was imdertaken to examine the effects of the 
Texas test. Was testing teachers an effective educational reform? Can lessons from 
the Texas experience inform policy decisions in other states? 

Fiesearch Methods 

The two-year-long research project involved 10 separate data-collection stud- 
ies including: structured interviews with key legislators and aides, interviews with 
random samples of educators, personnel directors, and Texas citizens, a compilation 
of Select Conmiittee and legislative records, analyses of test results by categories of 
teachers, content analysis of newspaper stories, a survey of study materials, partic- 
ipant observation at test-preparation workshops, and cost analyses. 

Political Context 

A test for practicing teachers was one element in an omnibus educational 
reform bill passed in Special Session in the summer of 1984. The Texas reform 
legislation provided for redistribution of resources to poor school districts, higher 
starting salaries for teachers, a career ladder, statewide textbook adoption, a high 
school graduation test, the famous "no pass, no play" rule, and a dozen more 
changes. Originally there were to be two levels of testing for current educators: 
subject-matter tests and a test of each examinee's ability to read and write. (The 
Texas legislature subsequently rescinded the requirement for subject-matter tests 
in April 1987.) 

The climate of opinion leading to educational reform in Texas closely paral- 
leled developments in other parts of the coimtr>. There was wide-spread concern 
about A Nation at Riskj especially test score declines and the low standing of 
Texas compared to other states. Economic woes caused by a precipitous d^op in oil 
nivenues drew attention to rhetoric about the links between sound education and 
economic prosperity. Multi-millionaire H. Ross Perot, appointed by the governor 
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to chair the Select Committee on Public Education, was a driving force for reform. 
Business leaders heard from one of their own that Texas could not hope to com- 
pete for high technology investments if northern executives were unwilling to move 
their families to Texas schools. Perot also made headlines with the charge that the 
"Dumbest People in College Study to be Teachers." 

During the Special Session teacher testing became a bargaining chip to lever- 
age a tax increase. Legislators wanted something tough to show to their constituen- 
cies. "No test, no tax" became the slogan, which resembled very closely the rhetoric 
leading to the Arkansas teacher test. 

The TECAT 

Implementing a testing program for 210,000 current teachers was more cum- 
bersome than policy makers had imagined. Ntmaerous validity and legal problems 
prevented the use of existing tests or previotis test scores (such as SAT's). The 
State Board of Education reported to the legislature that 15 million dollars would 
be required to implement subject-matter tests and supported the Commissioner's 
assessment that "a basic skills test alone would weed out SO or 90% of incompetent 
teachers." 

A new test, the TEC/T, was developed to assess the minimum reading and 
writing skills "that practicing educators need to perform adequately in their jobs." 
The 55 item, multiple-choice reading test included reading comprehension and job- 
related vocabulary questions. The writing test included both a short composition 
(150 words) and a multiple-choice portion. School personnel who failed the reading 
or writing part of the test in March of 1986 had one chance in Jime to retake the 
portion they had failed. Subsequent retakes were permitted but not in time to 
prevent their being without a certificate in September. 

FINDINGS 

Massive Preparation 

Statewide, enormous effort went into preparing teachers to take the TECAT. 
Study guides and review materials were developed by the Texas Education Agency, 
tmi^^ersities, teacher organizations, districts, and regional education centers. Work- 
shops were offered for pay or at district expense. Review videos were available 
through satellite delivery and constant programming on public access TV stations. 
On average, educators spent 12 hours preparing for the test. Although one-fourth 
of teachers spent an hour or less reviewing for the test, other teachers spent as much 
as 100 hours preparing. 



Basic Skills and "Teaching to the Test" 

On the first try, 96.7% of educators passed. Based on field test data, passing 
standards were set where 12% would have failed. Although the Commissioner and 
his staff had expected a higher passing rate under real testing conditions, the gain 
was much greater than anticipated. 

Some attributed the high passing rate to development of teachers' skills in 
workshop sessions. Direct observation suggested, however, that there was tremen- 
dous teaching to the test. In many cases teachers learned to take advantage of the 
multiple choice format to improve their scores. Only 3% of teachers interviewed 
said they learned new skills during their test preparation. 

TECAT Passing Rates 

• 96,7% passed TECAT on the first try. 

• Initial passing rates for Hispanics and black teachers were 94.0% and 81.6%, 
respectively, 

• By the second try 99% passed. 

• TECAT removed 1,199 teachers who failed twice and 676 educators who 
did not sign up to be retested, 

• More than half of the educators fired by TECAT were in nonacademic 
positions. Special education teachers and staff firom group homes, P.E, teachers 
and coaches, and vocational education teachers (who had never been required to 
have college degrees) were over-represented among the failinres. 

Teacher Morale 

• 90% of teachers reported that the test had had a demoralizing effect on 
them or their colleagues. Even the 25% of teachers, who did not feel threatened by 
the test (and did not study), said that it had a negative effect. 

• Teachers felt degraded by having to study for such a low-level test. 

• An atmosphere o^ stress and bitterness was created by the high-stakes, of 
literally losing your job if you failed. Many said the effect would have been different 
if not passing meant having to take a college refresher course. 

Public Confidence 

• One-half of the teachers interviewed said that the test accomplished its 
purpose, "to weed out incompetent teachers and reassure the public." 

• The other half said that negative publicity and the high-passing rate made 
TECAT a joke. 
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• Actual public opinion data from The Texas Poll showed a greater decline 
in pubhc support for teacher competency testing, before and after TECAT, than 
for any other educational reform. 

Cost Analysis 

• Test development and adminstration cost over $5 million. 

• Counting a teacher inservice day to take the test and district sponsored 
workshops, the total public cost was $35.5 million. (Alternative uses of these 
dollars to serve the same end might have been to create a fund to support the legal 
costs of districts seeking to fire incompetent teachers.) 

• During the Special Session, Comptroller's estimates had shown teacher 
testing as a cheap reform; real pubhc costs were 10 times greater. 

• Private costs in tesurher time and preparation expenditxu^es were an ad- 
ditional $42 million. (Alternative uses of this resource might have been to require 
more advanced study by teachers.) 

• If the wages of low-scoring teachers were "wasted" before TECAT, then 
the 887 academic decertifications that occwred because of TECAT represent aix 
annual savings of $25 million. 

CONCLUSIONS 

Research on the Texas teacher test found contradictions: 

• The basic hteracy test was never expected to fail more than 5-10% of Texas 
educators, yet 75% of teachers spent considerable amoimts of time preparing. 

• While many educatoi'S with poor reading and writing skills used test taking 
tricks to pass the test, there were lamentable losses among the failed teachers, 
especially* vocational education and special education tesichers. 

• The cost was 10 times greater than expected and the failure rate 1/10 of 
that expected, resulting in a pubhc cost per failed teacher of $30,000. 

• During Perot's Select Committee hearings, a test to ehminate the few 
incompetent teachers had been intended to raise the status of the teaching profession 
so that in the future top college graduates would be attracted to teaching. Ironically, 
many believe that pubhcity about incompetents, teacher complaints alongside easy 
test questions, and union irsistence on contractual rights, hurt the esteem of the 
teaching profession. 

Although the blame for negative side effects must be widely sh&.ed, the 
realities of teacher testing deny the simpUcity of the intended policy- "give a test 
and ehminate the few teachers with indefensibly weak communication skills." 
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Section 1: INTRODUCTION 



Purpose of the case study 

Texas grabbed the attention of the national news media when in March 1986 
202,000 teachers and school administrators were tested to see if they could keep their 
jobs. They took the TEC AT, the Texas Examination of Current Administrators and 
Teachers; it is a litersury test measuring basic reading and writing skills required of 
teachers. Texas is one of three states with programs in place to test the competency 
of practicing teachers but Texas received the most attention-perhaps because it is 
so big. In Georgia onl} 15,000 teachers have taken various subject matter tests; 
in Arkansas the number tested is under 37,000. The Texas teacher test was also 
especially controversial aad newsworthy because educators were Jiterally to be fired 
if they failed the test twice. Lifetime certificates were not protection against taking 
the test. In Arkansas teachers who failed the basic skills tests could keep retaking 
them and continue teaching in the meantime. In Georgia veteran teachers were to 
have eight chances to retake the test before the first certificate could be denied in 
August 1987; teachers with lifetime certificates were exempt from taking the tests. 

Researchers at the Center for Research on Evaluation, Standards, and Stu- 
dent Testing found the Texas teacher test an unusually visible example of a re- 
form strategy contemplated by many other state governors and legislators. Policy 
makers who wish to improve public education see several options: increasing high 
school graduation requirements, lengthening the school day, testing students, testing 
teacher candidates, redistributing resources to poor schools, revising curriculum or 
in some way enhancing the professional status of teachers. Testing practicing teach- 
ers is an approach that has considerable appeal because it is a concrete and decisive 
action aimed directly at the quality of education in the classroom. Everyone says 
that teachers make a great difference. Surely, if incompetent teachers are upgraded 
or removed, learning and educational opportunity will increase. 

The purpose of our research was to examine the Texas experience in testing 
practicing educators. Are there lessons to be learned from the Texas case that can 
inform poHcy decisions in other states? What were the educational problems and 
political context that gave rise to the reform legislation? How were testing and a 
particular type of test decided upon? At the time the legislation was enacted, what 
did advocates and opponents believe the effects of testing would be? Then, after 
the test was given, what were the effects of testing'^ Who failed? How did local 
districts replace the teachers who failed twice? What can be said about the impact 
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of the teacher test on the quality of education and pubHc confidence in schools? 
How much did the testing program cost and were the benefits worth the cost? 

Organization of the report 

The above questions are addressed in subsequent sections of the report fol- 
lowing a roughly chronological ordering of topics. Data from multiple sources are 
brought together as they bear on particular themes, rather than enumerating sep- 
arately the results of each data gathering activity. For example, some teacher 
interview questions are combined with workshop observations in the discussion of 
test preparation. Content analyses cf newspaper stories are presented along with 
other documentary evidence and legislator interviews in the discusjion of political 
context. 

Because the technical report is intended to be the repository for research 
methods, a somewhat lengthy section follows detailing the procedures used in vari- 
ous aspects cf the investigation. In the same spirit, illustrative segments of interview 
and obser nation transcripts are reproduced in the discussion sections. For less de- 
tailed reading, a policy summary is provided in the first pages of this report; in 
addition, an intermediate length narrative has been prepared for the Educational 
Researcher, 1987, 16, 22-31. 
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Section 2: RESEARCH PROCEDURES 

Newspaper Accounts 

Before the first site visit May of 1936, newspaper stories were used to ob- 
t \ rkground information about the TEC AT and educational reform in Texas. 
Two Texas newspapers were examined systematically: the Austin American States- 
man, an independent daily from the state capital, and the Amarillo News- Globe, 
an independent daily from the Panhandle's largest city. Prom the Statesman files, 
articles were obtained under the following headings: 1) the TECAT until April 
1986; 2) the 1984 special legislative session; and 3) the Select Committee on Public 
Education. From the archives of tho Amarillo News-Globe, articles were obtained 
from three files: "School testing," "1984 special legislative session," and "H. Ross 
Perot." Using all of the above descriptors, a small set of articles was also obtaired 
from the New York Times. 

Prom the news accounts, a chronology of events was constructed so that the 
researchers could be as well informed as possible when interviewing key participants 
(See Appendix A). Newspaper stories were also used to identify key informants such 
as legislators and imion spokespersons. 

Newspaper clipping.<i were also obtained in a less systematic fashion from 
several other papers, including the Dallas Morning News, the Dallas Times Herald, 
the Houston Chronicle, the San Antonio Express, the Texas Observer, the Fort 
Worth Star Telegram, and the Houston Post. In several cases, legislative staff 
members would pass along clippings from their files at the time of study interviews. 

In the fall of 1986, after all site visits and 80% of teacher interviews were 
completed, a content analysis was undertaken of the two complete newspaper files. 
The purpose of the analysis was to determme how public school teachers were 
portrayed by the press. 

Interviews with Key Figures 

Key political figures and informants were identified from newspaper accounts 
and by asking each respondent for the names of other central participants. Below 
are the names and titles of those who were interviewed: 

Bill Haley 

Chairman of the House Public Education Committee 
author of H.B. 72 

member of the Select Committee on Public Education 
"Gib" Lewis 

Speaker of the House of Representatives 

member of the Select Committee on Public Education 
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Carl A. Parker 

Chairman of the Senate Education Committee 
member of the Select Committee on Public Education 
Camilla Bordie 

Paxhamentarian for the Lt. Governor's office 
Nancy P-ank 

Administrative Assistant for the Senate Education Committee 
Dr. Terry Heller 

Research Specialist, Senate Education Committee 
Margaret LaMontaigne 

Chief Clerk, House Public Education Committee 

Melinda Terry 
Speedcer's ofiice 

Brian Wilson 

Education Specialist, Governor's office 
W,N. Kirby 

Commissioner of Education 

Dr. Marvin Veselka 

Assistant Con missioner. Assessment 

Dr. Nolan Wood 

Director, Teacher Assessment 

Charles Beard 

President, Texas State Teachers Association and 
Ermalee Boyce, Executive Assistant 

John Cole 

President, Texas Federation of Teachers 
Thomasine Sparks 

President, Texas Classroom Teachers Association 
Mike McLamore 

Governmental Relations, Association of Texas Professionzd Educators 
Nae Dom 

Spokesperson for the BlacK Teachers Caucus 
Austin Association of Teachers 

Donna New 

President, Austin Association of Teachers 
interviewed with a group of Aufatiii teachers 

Three central figures were not interviewed either because of accessibility or 
availability during planned trips to xas: 
Governor Mark White 

Lieutenant Governor William P. Hobby 
H. Ross Perot 

Chairman, Select Committee on Public Education 
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References in this report to the intentions and actions of White and Perot 
are based on transcripts of political speeches, on newspaper editorials, quotations 
from newspaper articles, and attributions to them by the participants interviewed. 
Without personal interviews, however, it i? not possible to represent their latei 
reflections on the implementation and impact of TEC AT. 

The list of important participstnts and of individuals with valued perspec- 
tives was much longer than the set interviewed. The individuals and groups listed 
below were identified as possible informants but were not contacted because of the 
limitations of study resources. Note that constraints were caused both by limita- 
tions on the researchers' time and by geographic distances. Thus, some less central 
participants were interviewed because of their availability in Austin at the time of 
a scheduled visit. 

Stan Schleuter 

Chair, House Ways and Means Committee and 
member of the Select Committee on Public Education 
June L. Karp 

Assistant to the President, Texas Federation of Teachers 
The Mexican American Legal Defense and Education Fund 
The League of United Latin American Citizens 
Enunett J. Conrad, M.D. 

member of the Select Committee on Public Education 
member of the newly appointed State Board of Education 
Bill Clements 

past governor, candidate for governor (and again, governor) 
John Sharp 

Senator, author of S.B. 103 to reduce testing requirements 
Raymon Bynum 

Commissioner of Education during Select Committee hearings 
James Butler 

President of TSTA during Select Committee hearings 
Bill Hammond 

member of the House Public Education Committee 
Rick Salwen 

attorney and lobbyist for H. Ross Perot 
Frank Metdla 

House Public Education Committee 

member of the Select Committee on Public Education 

A structured interview protocol was developed (See Appendix B). The logic 
of the questions proceeded chronologically, asking respondents first to think back 
to a period before support for a teacher test had developed. They were asked to 
describe the political climate and key events that led to the inclusion of a test in 
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the r-form legislation. Each respondent was asked to describe his or her own role 
in the enactment of the legislation and to characterize the positions of proponents 
and opponents. They were asked their perceptions about the impact of the TECAT 
and for advice to legislators in other states. The written protocol went through 
two stages of revision after review by two colleagues outside the University who are 
experts at survey instrument construction. 

One interview was tailored to 15 minutes by selecting a subset of questions 
to accommodate the schedule of a key legislator. Complete interviews were from 30 
minutes to two hours in length. 

All interviews were conducted fact-to-face by the principal investigator or a 
trained graduate assistant. The sessions were tape recorded with the permission 
of the respondents. Extensive notes were also taken on the printed schedule of 
questions. Audio tapes were transcribed; analyses were conducted using the vvritten 
transcripts. 

Interview transcripts were read in several stages for increasingly refined pur- 
poses. In the first stage, segments were coded as answers to preordinant questions or 
as emerging themes or issues. Identifying labels were assigned to new issues to link 
recurring themes across interviews. In subsequent stages, subtypes or competing 
positions were identified. No attempt was made to quantify the results. Marginal 
codes were used to collect exemplars of each position and theme. 

Documents 

The Texas Education Agency provided copies of TECAT descriptive materi- 
als and the TEA produced Study Guide. The data presented to the State Board to 
facilitate standard setting were obtained as well as the deia on results. TEA staff 
provided a transcript from an early meeting of measurement specialists. Documen- 
tation and data for the EXCET test were also supplied. We relied on professional 
papers, v*^! it ten by the test contractors for descriptions of development procedures. 

The governor's office granted us access to the documents that had been 
distributed during the Select Committee hearings. We obtained xerox copies of 
meeting agendas, data that were presented to the committee such as SAT scores, 
transcripts of testimony from educator groups, and drafts of findings from various 
subcommittees. 

Many other documents were used in the course of the study but were not 
gathered systematically. Often informants gave us copies of documents from their 
files, including transcripts of speeches made to the Special Session of the Legis- 
lature. Spokespersons from various teachers organizations gave us copies of their 
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instructional materials, newsletters, and prepared testimony. If informants referred 
to data or reports, we used the legislative library, the TEA archives, and the Select 
Committee records to track down these sources. The Texas Poll, also called the A 
& M poll or "public opinion" poll, was referred to often. We contacted the Public 
Policy Resources Laboratory, Texas A & M University, which conducts the Texas 
Poll, for a complete set of their releases on education issues. 

Teacher and Administrator Intervieivs 

Sampling. A representative sample of Texas teachers and administrators 
was selected using a two-stage sampling strategy. At the first stage, the 1985- 
86 Texas School Directory (TEA, 1985) was used to stratify all school districts 
by size. The stratum of largest districts was defined as those with enrollments 
over 38,000. The nine largest city school systems in Texas are thought of as an 
identifiable group; thus, the 38,000 cutoff was chosen to distinguish this group from 
mediimi-sized districts. Then, a cutoff of 10,000 students was arbitrarily chosen to 
distinguish medium-size districts (10,000-38,000) from small districts (<10,000). 

Using a table of random numbers and district identification numbers, eight 
districts each were selected from the small and medium strata. The sampled districts 
and their enrollments are reported in Table 2.1. 

In addition, four districts were chosen from the large stratum according to 
the following procedures. First, Houston ISD was eliminated because it was the 
only district whose teachers were excused from TECAT; they had taken a similar 
competency test administered by the school district. Then the remaining eight 
districts were assigned to geographic clusters: El Paso and Ysleta; San Antonio, 
Northside and Corpus Christi; Austin; Dallas and Fort Worth. Then, one district 
was chosen from each cluster; Corpus Christi was purposefully selected because the 
southernmost region of the state had been missed by the random sample of medium 
districts; Ysleta and Fort Worth were selected to represent their respective locales 
by flips of a coin; Austin, as a set of one, was automatically selected to achieve 
geographic spread. 

For each of the 20 districts identified in the first stage, population lists of all 
teachers and administrators who had registered to take the TECAT were generated 
by the Texas Education Agency. In the second stage, teachers and administrators 
were selected at remdom from their respective stratum lists. To achieve a total 
sample of 100, 21 were selected from the large stratum, 34 from the medium stra- 
tum, and 45 from the small stratum. The sample proportions correspond to the 
proportions of certificated personnel from all districts statewide of these respective 



Table 2.1 

Districts, selected in the first stage of sampling by size 
(Teachers and administrators were then selected at 
random from these districts) 

Large Districts (over 38,000) 

Austin 58,540 

Corpus Christi 38,440 

Fort Worth 66,085 

Ysleta 46,486 



Medium Districts (10,000 - 38,000) 



Birdville 16,249 

Cypress-Fairbanks 30,424 

Irving 20,415 

Lubbock 28,953 

Mesquite 20,327 

North East 35,250 

Richardson 33,853 

Round Rock 1^,690 



Small Districts (less than 10,000) 



Banquete 


721 


Crystal City 


2184 


Highland Park 


4348 


Henderson 


3696 


Lakeview 


120 


Penyton 


2068 


Rocksprings 


460 


Van Vleck 


1160 



sizes. (Population proportions were computed from the school directory.) By sam- 
pling at random from within each stratum, larger districts of each type naturally 
contributed more subjects to the sample; the number sampled per district ranged 
from 4-7 in the large stratum, from 2-6 in the medium stratum, and from 1-12 in 
the small stratum. 
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The registration lists provided by the TEA included the following information 
for each teacher: name, address, home phone number, work phone number, date- 
of-birth, sex and ethnicity. Blanks occurred if an examinee had declined to provide 
information on the registration form; however, incomplete information occurred in 
less than three percent of the cases. 

The data in Table 2.2 provide comparisons between the sex, age, and eth- 
nic characteristics of the 100 teacher-administrator sample and ihe population of 
202,084 educators who were tested. 

Table 2.2 

Population and Sample Characteristics 
of Teachers and Administrators Taking TECAT 

Population Original N onresponse 

Tested Interview Sample from Sample 





(n = 202,084) 


(n = 100) 


(n = 


SE\ 








Male 


50,953 (25.3%) 


27 


1 


Female 


150,735 (74.0%) 


71 


3 


Not Given 


43 (00.0%) 


2 




AGE 








0-29 


38,971 (19.3%) 


16 




30-39 


74,706 (37.0%) 


39 


3 


40-49 


52,349 (25.9%) 


25 




50-59 


29,984 (14.9%) 


13 


1 


60-65 


4,615 (02.3%) 


1 




>65 


721 (00.4%) 






Not Given 


384 (00.2%) 


6 




ETHNICITY 








Black 


15,681 (07.8%) 


7 




Hispanic 


24,685 (12.2%) 


10 


2 


White/Other 


156,505 (77.6%) 


80 


2 


Not Given 


4,860 (02.4%) 


3 
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The difference between the sample and population percentages are illyrira,' 
tive of the magnitude of statistical error expected from simple random fluctuation 
and the additional error created by two-stage cluster sampling. 

Nonresponse bias. The response rate was 96%; i.e., interviews were con- 
ducted with all but four of the sample of 100 teachers and administrators. Two of 
the missing cases had moved from the state and had given no forwarding information 
to their school. Two refused to be interviewed. The nonrespondents were evenly 
distributed across the three district-size strata: two f^om the medium stratum, and 
one each from the large and small strata. 

Age, sex, and ethnic characteristics of the nonrespondents are shown above 
alongside the population and sample figures. Two of the nonrespondents were 
Hispanic. One white female, who declined to be interviewed, was in the 50-59 age 
category. An Hispanic male who had left the state was from a district with an 
imusually high failure rate. Although no attempt was made to ask school or district 
personnel about TECAT results for the nonrespondents, it is reasonable to surmise 
that some number of the four nonrespondents did no* pass the test, at least on the 
first administration. 

In a sample of 100, three would be the expected number of failures on the 
first test; only one person would be expected to fail twice. All of the respondents 
reported that they passed the TECAT. Although there might be some moti^^tion 
for the respondents to dissemble even in a telephone interview, it is also quite 
conceivable that the only fsulures in the sample were among the nonrespondents. 
Thus, we believe that two or three of the very most negative opinions regarding the 
testing program may have been omitted. The small nonresponse rate, therefore, 
may have created a slight positive bias in the interview results. 

Interview procedures. Because of the great geographic extent of Texas, 
telephone interviews were used with teachers and administrators rather than con- 
stratin the representativeness of the sample. A structured protocol was devised as 
shown in Appendix C. Interviews were conducted by trained graduate assistants 
and in a few cases by an Hispanic sumamed, Spanish speaking staff member. A 
standard introduction describing the purpose of the study is shown at the top of 
the protocol. Age, sex, and ethnic status were known from the population lists and 
did not have to be a^ked during the interview. 

The interview tapes were transcribed. In addition, verbatim comments were 
written down as much as possible during the interview. Quantifiable questions, such 
as the number of hours spent studying for TECAT, were coded and summarized 
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using simple descriptive statistics. Transcript responses were divided into five qual- 
itative question sets: the respondent's own preparation for the test and attitudes 
toward TECAT, questions about what the test measures and fairness, what the 
respondent could tell us about the characteristics of teachers who had failed, policy 
questions about legislative intent and advice to other states, and questions about 
the effects of TECAT on teachers and on public opinion. The question sets were 
read to identify categories or types of perspectives. Then the data were reread to 
group the responses by type, to identify subcategories, or to reexamine distinctions 
between categories that had begun to merge. Finally, categories and subcategories 
v/ere each reread to select illtistrative quotations. 

Service Centers 

There are twenty regional Education Service Centers in Texas. These centers 
joined school districts and teacher organizations in providing preparation courses 
before the first administration of TECAT. After the first test, the Service Centers 
were specifically charged by the Conmiissioner of Education to provide additional 
help to the 6,000 teachers who had failed. 

Each of the 20 centers were contacted to learn what review or informational 
services had been provided prior to the March testing as well as what remediation 
opportunities were being offered prior to the June 28 administration. These phone 
interviews were conducted informally with whichever professional staff person was 
designated as the person responsible for TECAT. In cases where instructional mate- 
rials had been developed, copies of the materials were requested. A standard set of 
questions was used to inquire about the population of failures in that region: what 
percentage had failed?, what information did the center have about the number of 
individuals who needed remediation?, how was information being distributed, given 
that the names of failed examinees were not known? 

The telephone contacts were also used to determine the schedule of specific 
workshop dates and locations to be held in preparation for the June retesting. We 
asked for permission to attend these workshops, or how permission to attend might 
be obtained. 

Preparation workshops 

The principal investigator and a research assistant attended a total of five 
days of workshop sessions representing three different service center sites. The 
sites selected can be described as both a convenience and judgmental sample. We 
wished to achieve geographic and demographic distribution; we also wanted sites 
to be accessible to a major airport (which ruled out 10 of the 20 centers). One site 
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was purposely selected to be in a more rural area; we also elected to attend only 
one workshop where the University of Texas video tapes were to be the mode of 
instruction. Three centers that we wished to visit denied us access; two of these 
were instances where the center had contracted with a university or college for 
instruction. In these cases, the instructors refused to have us attend because the 
workshop participants had paid for the sessions and were imder considerable stress 
that would be heightened by the presence of an outside observer. 

The researchers introduced themselves to each instructor and confirmed per- 
mission to record the session. The audio recordings were transcribed and analyzed 
to identify categories of evidence using methods described previously. 

Two instructors were formally interviewed using the Public Figures Interview 
Protocol shown in Appendix B. Instructors were also asked about the similarities 
and differences between the current workshop and previous review sessions they 
had conducted. All instructional materials made available to the participants were 
purchased or collected. 

Teacher Questionnaires 

Because the percentage of educators failing TECAT was so small statewide, 
it was expected that the probability sample of teachers would produce very few 
failing candidates. Lists of failing candidates were not available. The remediation 
workshops conducted to prepare for the Jime 28 test retake were viewed as an 
opportunity to learn the opinions of individuals who had failed the test. These 
workshops were also attended by individuals who had not been employed during 
the school year and so would be taking the test for the first time on the June date. 

Although we wished to learn the opinion of some teachers who had failed, 
our methods could not be aimed at obtaining a scientific sample of the failing 
population. At the v orkshops we attended, we approached individuals before and 
after sessions and asked if they would be willing to respond to our research questions. 
The protocol used for teacher telephone interviews (shown in Appendix C) was 
rewritten to be a self-administered questionnaire. Thirty-nine written responses 
were obtained; the respondents were about equally divided between those who had 
failed the test previously and those who were taking the test for the first time. 
The self-administered questionnaires were also distributed by instructors at three 
workshop sites where we had not been able to attend. Nine written responses were 
received from participants at these sites. 

Personnel Directors Interviews 




A sample of 20 districts was identified. These were the same 20 districts 
selected by stratified random sampling in the first stage of the teacher samphng 
procedure. In the fall of 1986, directors of personnel were interviewed in 19 of these 
districts. One director of personnel, in a district with a high failure rate, refused to 
be interviewed. 

Again telephone interviews were used following a standard protocol shown 
in Appendix D. Directors were asked about the general impact of TECAT, abou^ 
procedures in their district to inform teachers, and about specific questions ad- 
dressed to the personnel office. They were asked about the teaching qualifications 
of teachers who failed and about the incidence of teachers not taking the test. Other 
questions pertained to the specific treatment of teachers who failed and to the more 
general handling of teacher shortages in that district. 

Methods of analysis described previously were again applied to written tran- 
scripts of the personnel director interviews. 

Cost Analysis and Miscellaneous Data Collection 

The methods used in the cost analysis are described along with findings in 
the relevant section of the report. Data used in support of the cost analysis were 
obtained from public dociunents, from otu* own probability sample of teachers and 
personnel directors, or from nimierous miscellaneous phone calls made to acquire 
necessary facts. For example, a call was made to Dr. Shirley Crooks who had 
directed development of materials and training sessions at the University of Texas 
at Austin. We called cable TV stations in several major cities to obtain the schedules 
of TECAT broadcasts. We contacted the authors of the Texas Poll for additional 
information. We also contacted the Texas Interactive Instructional Network (TMN) 
which was responsible for delivering video review sessions by satellite. We called 
various members of TEA staff repeatedly for facts and documents to support our 
analyses at various stages. 
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Sectjon 3: POLITICAL CONTEXT 



Climate for Reform 

The enactment of a law to test practicing teachers and administrators had 
immediate historical antecedents. Nearly every participant recounted to us these 
key events: Governor Mark White's promise to obtain a pay raise for teachers, 
the national reports describing the crisis in education, hearings held by the Select 
Committee on Public Education, and the political caldron of the legislative Special 
Session from which an entire package of educational reforms emerged. Thus the 
short-term history of the teacher test began in the legislative session of 1983 and 
culminated in a reform bill in the summer of 1984. These major events are used to 
organize the ensuing analysis of political context. 

However, some informants, legislators, aides, and teacher representatives, 
were able to think back further. They gave accounts spanning more than a ten- 
year period. They described the economic and social conditions in. Texas, that 
precipitated the reforms and gave them their particular flavor. 

The perception of poor student performance in the form of low test scores 
had been around for a long time. Nationally, test scores (SATs) were declining and 
Texas was at the bottom in the ranking of states. These facts were repeated to us 
often, usually \vithout reference to specific dates or numbers, sometimes without 
knowledge of the specific test. The perceived deficiencies in the educational system 
had become a part of the Zeitgeist. Talk decrying incompetent graduates of the 
public schools Wets heard in Texas just as it was in every other state As one analyst 
described: 

You and I know that in education we have had accountability as a 
movement for some 10 years now. It started with hack to basics; 
part of back to basics was the accountability movement You have a 
curriculum and then you want to measure it I think we were on the 
tail end of that movement I think it was a true education movement^ 
as well as the fact that we did have terribly low student achievement 
scores.... 

While politicians blamed education, teacher organizations complained that 
the problems facing public education could not be solved if teachers continued to 
be paid substandard wages. From a Texas State Teachers Association member: 
Well from my perspective it began before the special session of the 
legislature. There was a long list of things that had taken place be- 
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forty that probably go back two or three governors: political activities^ 
teachers working to get salary increases and better working conditions. 

Looking back, political. rhetoric about correcting the ills of public education, 
was tied to business interests and accelerated when Texas first felt the effects of 
economic recession. According to a teacher representative: 

They wanted to move towards a high-tech state. And, in order to do 
this, you have to have an educated populace that can fill those kinds 
of jobs. 

From a legislator: 

/ remember reading that creating (better) schools would attract high 
tech firms to Texas. I believe that high tech i$ an intellectually moti- 
vated industry, as opposed to construction work and that sort of thing. 
It follows good education. Good education doesn't follow it. They go 
to those states where there are good education systems. 

And from a legislative aide: 

(Businessmen) would give you the frosUbelt ;un-belt theory. More 
people were coming down here; but not so many (people) were being 
attracted to Texas as to other parts of the sun belt because we had 
a terrible education system. So business interests drove this whole 
machine, this whole education reform machine. 

Until 1980, oil had held Texas immune from economic troubles felt by the 
rest of the country. T:;xas had gone through the 1970's without a st«*e income 
tax and without raising the sales tax, all on the profits from oil. But when the 
world-wide energy glut reduced the price of crude oil, the state's dependency on oil 
revenues turned the boom to bust overnight. Between December 1981 and August 
1982, the state's unemployment rate jumped from 4.6% to 7%. In September of 
1982, Governor William Clements had to call a special session of the legislature 
to raise revenue for the bankrupt state unemployment fund. (Reporting on the 
continued decline in 1986, Time (4/14/86) noted that each $1 per barrel drop in oil 
prices meant for Texas a loss of 25,000 jobs and $100 million worth of state revenues. 
Prices have followed a steady decline from a high in 1980 of $39 per barrel down to 
$13 in 1986.) 

One education observer also suggested that at some deeper level, public 
concern about the quality of education, and specifically about the qualifications of 
teachers, was linked to the desegregation of schools. 
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There was always an underlying ih.ag not spoken by anyone that I 
know of; but, this has its roots deep in Texas, history^ and indeed 
in soui, em history. During the days of segregation, we not only were 
not proj. My concerned with educating minorities; we were as a society 
opposed to it. The government had written laws and the educational 
system had been structured in such a way as to prevent those people, 
no matter how hard they tried, from getting an education. A few people 
(overcame) the system; but by and large, it was a successful system. 

In keeping with that system, we d,d not care who taught in the 
black schools or the Hispanic schools,. Standards for graduation from 
black colleges, such a3 Texas Southern and Prairie View A & M, were 
notoriously low. You did not even have to hare a college diploma to 
teach in black schools. J know in many cases it was not even required 
that you have a high school diploma. 

We integrated schools, ostensibly, in 1969 in Corpus Christi. 
(But), the alleged integration did not occur until they began bussing 
studt. *s in 1975. Then, two things started to occur. First, the faculty 
was integrated in 1970 there. Faculties were integrated, so some of 
these teachers showed up in so called white schools teaching white 
middle class kids. It was suddenly a concern that no one wanted to 
talk about. Secondly, when white kids were showing up in the so called 
minority schools (parents) were suddenly concerned. 

To a- < an example^ at the first administration of the Pre* 
Professional Skills Test (PPST) (a test for college juniors entering 
teacher training), about 54% of the state's students passed. But in 
selected location-^, for example, Texas Southern, which is primarily 
black, the figure was (15%) passing. 

Earlier Reforms 

TEC AT yfLs not the first Texas teacher test, nor was its omn'bus reform bill 
the first educational reform legislation. Earlier reform efforts were described to us 
by some informants who implied that change had not been effective before Ross 
Perot's special committee, and by others who suggested that the real reforms had 
come in the 1981 legislative session. 

In 1978, State Representative Dan Kubiak announced work on a new teacher 
certification process. He said that tougher screening should put an end to fiascos 
such as a recent event in Dallas where a large percentage of teachers failed standard 
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high school exams. "It should also eventually be the basis for getting 'decent wages' 
for teachers in Texas for the first time." {American Statesman, 8/21/78). (Thus, 
competency requirements and higher salaries were paired in political statements at 
least six years before the TEC AT legislation.) 

In 1979 Governor Clements created an Advisory Committee on L^iucation 
which issued its recommendations in June 1980. Among other things, the report 
said that the St Joard of Education should, "establish a state testing program 
for persons seeking Texas certification that assesses competency in general academic 
sk^Us, knowledge of subject natter in the teaching fiela, and proficiency in the skills 
oi teaching." (Governor's Advisory Committee on Education, 1980, p. 10-11). The 
Legislature should, "enact, as a first priority, a significant increase in salary and 
fringe benefits (including legal support as may be necessary) for all instructional 
personnel to make teaching positions competitive with professional positions in 
business and industry requiring equivalent preparation and training." (p. 12-13). 
The largel/ imremembered select committee also recommended the adoption of a 
"state basic cuniculum," funding for remedial summer schools, testing of student 
achievement, and state support for handicapped children. 

In October of 1980, a subcommittee of the House Committee on Higher Ed- 
ucation released a report recommending two levels of teacher testing. One test, 
measuring competency in reading, writing and arithmetic, would be given before a 
student entered an education degree program. A second test would be given at the 
conclusion of the program in the area of professional certification. The report also 
cited a dechne in teacher education degrees and said: "Students \vho normally would 
have enrolled in teacher education programs are not doing so because of the sacrifice 
financially, because of negative public perception of education at all levels, or pos- 
sibly because of the fact that women, long the bulwark of the teaching profession, 
are increasingly entering other professions." (American Statesman, 10/6/80). The 
morning edition of the Statesman ran the headline, "Exams proposed for teachers;" 
and the subtitle read, "Pay raises to be sought." (American Statesman, 10/7/80). 

In 1981, the legislature passed Senate Bill 50 mandating the two levels of 
teacher certification tests that had been recommended by the Commission on Stan- 
dards for the Teaching Profession and by the House Committee on Higher Edu- 
cation, and endorsed by the State Board of Education. In 1982, the Si^te Board 
adopted the Pre-Professional Skills Test (PPST) published by Educational Testing 
Service as the basic skills screening measure for admission into teacher education 
programs. The PPST was pilot tested in Texas in the Spring of 1983. The results 
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were reported to the State Board on July 8, 1983. By the tentatively set standards, 
one-third of would-be teachers failed; 80% of black college juniors failed; 60% of 
^^spanics failed; and 15% of Anglos failed. 

The test intended to coincide with completion of teacher preparation even- 
tually became the EXCET test, the Examination for the Certification of Educators 
in Texas, through State Board rulings. This testing program required the develop- 
ment of new tests corresponding to areas of specialization. After February 1, 1986, 
all candidates for initial teacher certification would have to pass both a professional 
development (elementary, secondary, or all-level) and a content specialization test 
( in areas such as art, biology, English, vocational home economics, or elementary 
comprehensive). 

The 67th Texas Legislature also passed House Bill 246 to reform the school 
curriculum. It was the state's back-to-basics mandate. Ad hoc curricular require- 
ments were rescinded and the State Board was empowered to upgrade and stan- 
dardize a core curriculum statewide. 

Mark White 

Governor Mark White won election in the Fall of 1982 against incumbent 
Republican William Clements. Although the beginnings of the oil recession may 
have contributed to Clements's defeat, many say that educators campaigning for 
White had been a significant factor in the election. White had promised to seek a 
pay raise for teachers. At the time, beginning teachers were earning $1110 a month. 
Many key participants, especially teacher representatives, began their recollections 
of the political events leading to TEC AT with Mark White's promise to eachers. 
"When Governor White was running for governor, he never did tell us that he could 
give us a 24% pay increase. But he said that he would push for it and he did." 

In his first address to the joint session of the Legislature, January 27, 1983, 
White called for at least a 24 percent "emergency' 'ncrease in teacher salaries. In a 
retrospective on educational reform, the Dallas Morning News (7/8/84) recounted 
the following steps in White's efforts to obtain the necessary tax increase. In his 
first budget message, in March 1983, he suggested that tax increases might be 
necessary and proposed that they be levied on "luxuries which people choose to 
consume and not on necessities which people need to survive." In May, with the 
session rapidly drawing to a close. White specifically proposed that taxes on beer, 
liquor, and video games be doubled and that taxes on cigarettes and gasoline be 
increased a nickel-a-pack and a nickel-a-gallon. Two weeks later, because of severe 
opposition in the Legislature, White withdrew his proposals for direct tax increases 
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and suggested, instead, that son^e sales tajc exemptions be eliminated and other 
taxes be "reformed." 

On May 30, 1983, the Legislature adjourned without action on White's pro- 
posals but with agreement to appoint a blue-ribbon study panel. In the last three 
days of the session, K.C.R. 275 by Representative Haley was adopted. It estab- 
lished the Select Committee on Public Education to study "issues and continuing 
concerns relating to public education in Texas, particularly school finance and each 
of its components— personnel support, operating costs, transportation, equalization, 
minimum aid, and the categorical-2dd programs-as well as the source of funding 
and structiu*e of the system." 

On June 16, 1983, Governor White appointed Dallas business magnate, H. 
Ross Perot, to chair the Select Committee. 

National Reports on Education 

A month before the close of the 1983 legislative session in Texas, the Na- 
tional Commission on Excellence in Education released its report, A Nation at Risk^ 
warning of the "rising tide of mediocrity" afflicting the nation's schools. Many 
participants in Texas reforms recalled this particular report by name; many more 
remembered national findings that heightened public concern over the deplorable 
state of education. We will quote several of the "Indicators of Risk" from the 
report which best correspond to the recollections of study participants; their ac- 
counts, however, were much less specific than this. What they remembered was 
that scjres were going down dramatically throughout the nation, that the problems 
were serious and pervasive. Facts cited in A Nation at Risk included the following: 

Some 23 million American adults art functionally illiterate by the 
simplest tests of everyday reading, writing^ and comprehension. 

The College Board's Scholastic Aptitude Tests (SAT) demonstrate a 
virtually unbroken decline from 1963 to 1980, Average verbal scores 
fell over 5^ points and average matht/natics scores dropped nearly 40 
points. 

Both the number and proportion of students demonstrating superior 
achievement on the SATs (i d., those with scores of 650 or higher) 
have also dramatically declined. 

Business and military leaders complain that they are required to spend 
millions of dollars on costly remedial education and training programs 
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in such basic skills as reading, writing, spelling^ and computation. 
(U.S. Department of Education, 1983, pp. 8-9). 

As seen by Texas political and educational leaders, the national reports were 
a call to action: 

^It) came at the same time that all the national reports began to come 
out. There was a great hew and cry here in Texas to change the 
system. So, they set up a study group under Ross Perot. 

There were a number of studiej underway. All of them came pretty 
much to the same conclusion; that is, we had some serious problems 
and something needed to be done about it. 

They came out with that report called, A Nation At Risk. That report, 
you know, that everybody quoted and nobody read. It blamed all of 
the problems of the nation on the education situation. It was a very 
popular thing to do. Suddenly, all of those people out there who had it 
in for teachers, who had it in for principals, who were sick of property 
taxes to support their local schools, agreed.... We were caught up in 
that (but) it did afford us the opportunity to do some serious things 
that needed to be done. 

I would say it probably was an awakening. We in Texas. ..have a ten- 
dency to say weWe a great state and (to) hide our head in the sand 
when we have a problem. I think a Nation at Risk, and several other 
publications that came out about that time, really (hit home). V^op 
out reports pariicula.ly (about) Hispanics and blacks became very pub- 
lic. It was a berles of those kinds of things that caused us to wake up 
and say, ^Hey, we are really in trouble. 

Recollections of tJie national reports also emphasized the connection between 
education and economic competition, especially U.S. shortcomings in comparison 
to the Japanese. This theme was then taken up by the Select Committee on Public 
Education. A Nation at Risk begins with these words: "Our once unchallenged 
preeminence in commerce, industry, science, and technological innovation is being 
overtaken by competitors throughout the v/orld." (p. 5) 

The economic analysis conveyed by the Commission's report is best repre- 
sented by this quotation: 

The risk is not only that the Japanese make automobiles more effi- 
ciently than Americans and have government si'^sidies for develop- 
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ment and export. It is not just thai the South Koreans recently built 
the worWs most efficient steel mill^ or thai American machine iools^ 
once the pride of the worlds are being displaced by German products. 
It is also that these developments signify a redistribution of trained ca- 
pability throughout the globe. Knowledge^ learning^ information^ and 
skilled intelligence are the new raw materials of international com- 
merce and are today spreading throughout the world as vigoro usly as 
miracle drugs^ synthetic fertilizers^ and blue jeans did earlier. If only 
to keep and improve on the slim competitive edge we still retain in 
world markets^ we must dedicate ourselves to the reform of our edu- 
cation system for the benefit of all-old and young alike^ affluent and 
poory majority and minority. Learning is the indispensable investment 
required for success in the ^information age^ we are entering. (U.S. 
Department of Education, 1988, pp. 6-7). 

The report went on to describe the demaxid for highly skilled worlcers created 
by technological transformations such as computers, computer-controlled equip- 
ment, lasers and robotics. 

An observer from a different time or different place might have found it 
strange that educational reforms were repeatedly linked with the manufacturing of 
automobiles. But this was the tenor of the perceived crisis in education that was 
recoimted to us: 

/ read a lot of articles praising the schools in Japan. The Japanese 
were taking over our economy with their marvelous products, like cars. 
They can build them cheaper because they have more efficient opera- 
tions, 

I think the national report, A Nation at Risk, certainly moved our 
state into this educational reform mode. It compared our schools with 
Japan and said that a great travesty was being done to our students. 
They were not accomplishing what they should (furthermore) Texas 
had traditionally been behind in SAT scores. 

Several informants who were a part of the reform process also cited other 
external events that contributed to the growing momentum in Texas. Interest in 
testing was a part of the agenda of the Southern Regional Education Board, the 
organization of southern governors. Politicians in Texas were keenly aware that the 
neighboring state of Arkansas was ahead of them in mandating a test for teachers. 
Finally, evidence about the poor quality of students going into teacher education 
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come to the fore again and again. The qualifications of teacher candidates had been 
a concern for years, leading to S.B. 50 in 1981. It continued as a subtheme whenever 
declining scores were mentioned. We will consider this recurring theme again, when 
we look at the work of the Select Committee on Public Education. 

H. Ross Perot 

A substantive account of Perot's and the Select Conmiittee's recommenda- 
tions for reforming education will be given in the subsequent section. Some separate 
consideration should be given, however, to the personality, reputation, influence, 
and color of the man who dominated public attention. Perot was the one who 
raised this particular select conmiittee from obscurity. Many said that it was the 
force of his tenacious insistence on the reforms that compelled lawmakers to reach 
agreement over enormous differences. According to one legislative analyst: 

(The test) was a fait accompli because Mr. Perot put up a couple of 
million dollars of his own money to make it a fait accompli. It was a 
miracle that zt the time we had all of the leadership saying all of the 
same things, speaking with one voice. The lieutenant governor and the 
speaker actually sat down at the same table and had the same things 
to say. You donH accomplish that unless you have a very powerful 
voice behind it. Much of that driving force is attributed to Mr. Perot. 

Perot is referred to as a Dallas multimillionaire. He is an electronics magnate 
with a penchant for politics. In 1970, Perot spoke to a joint session of the Texas 
Legislattae. He convinced them to organize delegations of Texans to visit North 
Vietnamese embassies and ^ ' ^ad for humane treatment of American prisoners of 
wau:. When he addressed the Special Session of the Legislature in June of 1984, 
he began by introducing S^m Houston, newly elected to the House of Representa- 
tives, who had survived forty-two months of solitary confinement in Vietnam before 
Perot's efforts to improve the lot of prisoners. According to a story in the Amer- 
ican Statesman (4/11/84), Perot spent large sums of his own money to lielp pass 
the War on Drugs legislation in 1981. He reportedly spent one-half million dollars 
to effect the work of the Select Committee. Then, he h'red his own lobbyists to 
work through the Special Session to see that his goals were not eroded by political 
compromises. 

The Select Committee was Perot's Committee. His name appeared in head- 
lines associated with radical reformation of schooling. For example, in the Amarillo 
Daily News: "Perot Unveils Education Ideas" (8/3/83), "Perot Wants to Fine Par- 
ents of Students Who Don't Mearure Up"(2/24/84), "Latest Perot proposal elitist, 
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undemocratic" (3/ 14/84), "Perot panel scales down reform plans"(4/20/84), "Perot 
Urges Special Session for Reforms" (5/4/84). The committee's business made the 
news at least weekly in papers throughout the state from August of 1983 until the 
Special Session in June 1984. The visibility of these committee hearings was in 
sharp contrast to the media attention given to Governor Clement's earlier com- 
mittee chaired by Willis M. Tate. In the files of the American Statesman, on the 
topic of teacher certification dating back to 1978, we found no story on the report 
of the Governor's Advisory Committee in June 1980, despite its recommendation 
for teacher certification testing, consonant with the recommendat'on of the House 
Committee on Higher Education. 

If Perot's reputation had not conmianded media attention, then certainly 
the punch of his one liners would have made school reform newsworthy. "We won't 
compromise on anything," said Perot {Amarillo Daily News, 5/23/84). Hi? hard- 
charging straight-talking style was ideally suited for press releases. "Scheduling 
academic subjects around band and spoi-ts is a joke," said Perot. He had similar 
disdain for vocational education programs: "We've got children leaving school in 
the middle of the day just to work to pay for a cat.'' (American Statesman, 9/11/83). 
Perot also had a larger vision of what was wrong with Texas education and what 
had to be done to fix it. His analysis, especially the arguments relating educational 
health to economic vigor, closely paralleled A Nation at Risk. Although we cannot 
adequately represent Perot's views, as distinct firom the reforms recommended by 
the committee, we have included an essay written by Perot as Appendix E. 

To say that Perot was powerftd and that he lead the charge for reform, does 
not imply that his views we^e 'iiiiversally shared. He had opponents, many of whom 
were educators whom he portrayed as self-interested protectors of the status quo. 
He feuded with the Chairman of the State Bocrd of Education and then fought 
hard to ehminate the elected board. As the programs of various specialized grotips 
came under attack, they countered that Perot had painted an unfairly negative 
picture. Often he saw simple solutions to complex problems. Perot's radical views, 
which garnered media attention, did not guau-antee equal time to both sides. His 
single mindedness, which got the job done, did not necessarily invite compromise 
nor make educators equal partners in the envisioned changes. 

Select Committee on Public Education 

The Select Committee took seriously its charge to review, from top to bot- 
tom, the structure of public education. Public hearings were conducted throughout 
the state. Nationally famous educational reformers were in^'ited to present their 
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ideas, e.g., Mortimer Adler, John Goodlad, and Admiral Rickover. The committee 

also heard testimony from numerous groups including the following: 
Texas Federation of Teachers 
Association of Texas Professional Educators 
Texas Classroom Teachers Association 
Tf xas Elementary Principals & Supervisors Association 
Texas Association of Secondary School Principals 
Texas State Teachers Association 
Interfaith Network 

Intercultural Development Research Association 

Mexican / merican Legal Defense & Education Fund 

Texans for Eruitable Taxation 

Blacks for Affirmative Action 

Texas Congress of Parents & Teachers 

In examining the records of the Select Coum[iittee and media coverage of ihe 
hearings, our focus was primarily on discussions of teacher qualifications and the 
origins of discussions of tesurher testing. However, these issues were part of a much 
larger picture. To convey the broader agenda, we will briefly describe the commit- 
tee structure and the corresponding sets of recommendations in the final report. 
There were five subconamittees. The subcommittee on Organization and Manage- 
ment considered every level of school governance; in the final report, an appointed 
State Board was suggested to replace the elected board, the powers and responsi- 
bilities of the Texas Education Agency were to be increased, school principals were 
to function as instructional leaders, and local boards were to make regular reports 
to the public. The subcommittee on Finance considered the mechanisms for equal- 
ization of funding. Many considered the redistribution of state funds mandated 
by subsequent legislation to be the most significant component of the educational 
reforms. The ptunriew of the subcommittee on State and Federal Relations included 
discipline management programs, alternative schools (for incorrigible youth), and 
protection for educators against frivolous lawsuits. The subcommittee for Educat- 
ing the Child was concerned with lengthening the school day, lengthening the school 
year, reducing class size, and adding thinking skills and technological literac to the 
three Rs. Their recommendations were ntunerous and highly specific, including the 
requirement that students not be exempt from taking final examinations. 

The subcommittee on the Teaching Profession was the locus of TEC AT his- 
tory. They considered testimony about the pool of candidates preparing to be 
teachers and about salaries for teachers in Texas and in the rxation. They heard 
proposals for career ladders and for competency testing. Each of these items will 
be elaborated further. 
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First, however, a markedly different overview of the Select Committee's busi- 
ness is offered from the perspective of newspaper accounts. The Select Committee's 
report is dull reading compared to '.he media stories that trailed the committee 
hearings. Even radical suggestions, such as extending the school day until 6:00 p.m. 
for some children, were presented in staid and neutral language in the report. In 
the press, the talk was much more flamboyant, from Ross Perot and many others. 
F\ithermore, the most controversial topics received the greatest coverage. We make 
this observation because the Select Committee reconmiendations would not auto- 
matically lead to draft legislation; it is conceivable that the images which appeared 
in the press were as important in shaping legislative action as was the formal report 
from the committee. 

Take as an exanxple, the conmiittee's concern with extracurricular activi- 
ties. The headline of a Statesman article read, "Perot questions emphasis on school 
sports." "The extracurricular system is gutting the school day, disturbing middle 
schools and invading the elementary schools," said Perot. "Texans must decide 
whether they want 'Friday night entertainment' or education." (American States- 
man, 9/15/83) At issue was both the cost of these activities compared to academics 
and the time stolen from the school day. In the same article. Senator Carl Parker 
was quoted as saying that he didn't see why it takes 9 to 12 adults "in match- 
ing shirts" to field a football team every Friday night "when we are scratching to 
keep the educational system from being held unconstitutional." Joining in on the 
spirit of the committee's concerns, the director of the University Interscholastic 
League agreed to push for rules that would require: higher scholastic requirements, 
cutbacks in elementary school athletics, reduction of coaching staffs, reducticJn of 
interference with school time, and elimination of "redshirting" by seventh grade 
athletes (American Statesman, 9/29/83). Many coaches and parents complained 
bitterly about the attack on athletics; "why not raise academic standards without 
cutting back on sports." (ilmenccn Statesman, 9/30/83). In October, the Board of 
Education passed a rule that students could not participate in interscholastic sports 
if they were not receiving passing grades in at least four courses. 

Other issues debated in the media are characterized by these headlines from 
the American Statesman: 

"Full-day school at age 4 suggested by teacher group." (1/14/84). 

"Longer school days u.-ged by public education panel." (1/17/84). 

"School finance plan fights rich-poor gap" (1/19/83). 

"Teachers hail salaries keyed to competence," (2/5/84). 
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"$15,200 base on teacher pay under review.'' (2/19/84). 
"Longer school year endorsed by panel." (2/21/84). 
"Teacher organization calls testing proposal 'absurd'" (2/22/84). 
"Charge to parents urged for failures by students." (2/24/84). 
"Full-day kindergarten urged by Perot panel." (3/6/84). 
"Perot attacks school board, urges ouster." (3/8/84). 

Otu- more intensive look at the origins of teacher competency testing was 
guided by the recollections of many key participants, legislators on the committee, 
staff assistants, and individuals who gave testimony. These individuals gave us 
detailed accotmts of how, from their perspective, this idea had taken shape in the 
Select Committee. These accoxmts were augmented by relevant dociunents from the 
committee archives. An integrated story of events has these key elements: 1. The 
conunittee was concerned by evidence that teachers in training were being drawn 
from the bottom of the college class. 2. The unattractiveness of a career in teaching 
was caused in part by low pay. 3. Based on test results and many anecdotes, 
the committee concluded that some significant fraction of practicing teachers were 
incompetent. 4, The conunittee had evidence that current procedures were not 
adequate to eliminate incompc;tents. 5. A pay raise for teachers, which had all along 
been a part of the conunittee's agenda, could not be jtxstified for the incompetent 
ones. 6. Competency testing could do what lame administrators had failed to do; 
testing was legally defensible and had public support. We will elaborate on these 
points in the following discussion. 

A backgroimd memo to the committee, entitled "Statistics Concerning the 
Decline of Students Entering the Teaching Profession," contained the following in- 
formation: 

Statistics gathered fvm the College Board illustrates that there is a 
rapid decline in the number of students entering the education field. 
The statistics were taken from responses given by students on the 
S.A.^.... The statistics also show that the S.A.T. scores for those 
entering the teaching profession have been consistently lower th^'^. the 
mean scores of all students taking the test. 

Table 3.1, reproduced from Weaver (1981), is a summary of College Board 
data from 1972-1979. As interpreted by Weaver, education majors maintained their 
same relative position through the SAT score decline, i.e., they continued to be at 
about the 37th or 34th percentile compared to other SAT takers. Weaver further 
noted that 1980 scores of education majors would have ranked them "just above the 
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bottom quartile in both verbal and math'' had they been compared to 1972 norms. 
Although none of our respondents made specific reference to Weaver's article in 
the Journal of Teacher Education^ this particular reference might explain why we 
heard that ^education majors are in the bottom quartile of their college class.^ At 
the end of the conunittee's work, Perot made headlines with his charge that the 
**Dumbcst People in College Study to Be Teachers." The relevant Amarillo Globe 
article (5/17/84) is reproduced as Figure 3.1; it recapitulates many of the themes 
of the Select Committee hearings. 



Table 3.1 

SATM*th ^nd SAT VrM AlMnf for Coll9g0'Bound SBntors 
S9lwcitng BducMiion and AnM/Sei9fK9s Af%s u 
ff/tl CftOfC* Co//«0ff Mmon. 1972-1979 





1972- 


1973- 


1974. 


1975* 


1976- 


1577- 


1978- 


1979- 




1973 


1974 


1979 


1976 


1977 


1976 


1979 


1960 








SATV 










Business 


409 


406 


406 


413 


402 


401 


400 


399 


Art 


440 


432 


435 


436 


412 


406 


404 


402 


Bio. Sci. 


493 


468 


461 


483 


475 


475 


472 


469 


Engiisn 


500 


496 


486 


489 


504 


504 


505 


507 


For. Lang. 


491 


463 


461 




481 


476 


475 


472 


Math 


491 


479 


463 


472 


464 


464 


459 


455 


Music 


465 


462 


448 


452 


445 


439 


437 


436 


Ptiil. 


479 


476 


469 


478 


467 


466 


465 


460 


Phytic So. 


SOS 


503 


501 


506 


500 


499 


496 


495 


Soc. Sci. 


478 


463 


465 


464 


456 


457 


455 


456 


En9inMfing 


466 


465 


450 


452 


446 


446 


445 


444 


Education 


418 


417 


405 


405 


400 


396 


392 


369 


National 


445 


444 


434 


431 


429 


429 


427 


424 








SATM 










Business 


463 


457 


461 


471 


453 


447 


447 


446 


Alt 


451 


441 


445 


443 


425 


422 


421 


419 


Bio. Sci. 


533 


528 


525 


530 


515 


511 


507 


506 


English 


481 


473 


465 


469 


478 


476 


478 


481 


For. Lang 


496 


. 494 


486 


467 


463 


477 


476 


475 


Math • 


595 


564 


560 


594 


566 


565 


560 


577 


Music 


487 


479 


464 


466 


463 


456 


456 


455 


Phil. 


500 


489 


464 


495 


487 


481 


482 


477 


Physic Sci 


570 


566 


565 


572 


572 


566 


561 


560 


Soc. Sci 


490 


477 


476 


475 


474 


472 


472 


473 


Engineering 


543 


554 


541 


550 


546 


540 


536 


535 


Eoucation 


449 


446 


434 


431 


426 


422 


420 


418 


National 


481 


460 


472 


472 


470 


468 


46'' 


466 



Source. College Entrance Examination Board. 

NttiOnti Co//ege Bound Seniors. 

Sub-Career Fields, Intended Areas of Study First Chotce 
1972-1979. 



Select Committee staff also conducted their own telephone survey of ^^1983 
high school honor graduates^ from 17 high schools selected to represent each region 
of Texas. These results were reported in a memo to the committee: 
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PEROT CHARGES^ 

'Dumbest Peo^^ 

HOUSTON (AP) — Someone on the elected state school board 
probably still thinks the world is flat, says the head of the state Se- 
lect Committee on Education, which has called for an appointed 
board. 

Continuing his campaign for an for an apiMintcd^high^t^lent" 
nine*member school board, school reforme d. Ross Pero liat- 
tacked the current elected 27-member board in a speech to the 
Houston Chamber of Commerce on Wednesday. 

"This is the group that gave us textbooks that look like People 
magazine," Perot told about 380 members of the Houston Chamber 
of Commerce. "This is the group that allows teachers that are illit- 
erate to get teaching certiflcates. And I'm sure that somewhere on 
that board there's someone who thinks the world is flat." 

The Dallas computer magnate said the state school system 
needs a board that will be held more accountable. 

"Just think for a minute what happens to a losing coach," he 
said. "We don't tolerate that. We do one of two things — we Are 
him or make him a principal." 

' Perot also callea for an improved teacher certification system, 
saying one*fourth of college student^ scoring lowest on the Scholas- 
, tic Aptitude Test are in teacher education programs, , 

"Bluntly put, the dumbest people in college today are studying 
to be teachers," he said. 

The state sends teachers to Stanford and Harvard universities 
and the Massachusetts Institute of Technology, Perot said, but 
they can't receive certification to teach in Texas public schools be- 
cause they never enrolled in college education programs. 

Perot said school officials should select teachers on the basis of 
competency tests and academic performance and personal quali- 
ties needed for teaching. He also called for better communication 
between educators and state officials.. , " 

"We do not listen ta the teacher in the state of Texas," Perot 
said. "We tell teachers what to do." ' 

The $8.3 billion appropriated for the state school system makes 
education "the largest business in Texas," Perot said. He said it 
should be run like a business. 

. Perot said 30 percent of state taxes are earmarked for educa- 
tion and said taxpayers aren't getting their money's worth. 

"Polks, you bought the ticket, you Just never got to see the 
show," he said. 

Perot said the state must "compete internationally" with other 
school systems. 

"Our international competitors are dead serious about educa- 
.tion,". Perot said. "While the Russians are busy pushing their 
children into mathematics, have have math for the nonmathemati- 
cjan." . • ' 

"Texas is in the 40s among th^ SO states in education." Perot 
said. "We're at the bottom of the bottom, and there's no place to go* 
but up. . .. 

"We've got a population ih Texas that doesn't necessarily look 
like you'd like them to look," he said, referring to handicapped and 
disadvantaged children. He said the state must "take children 
from all backgrounds and teach them." • 

.* Perot attacked vocational and distributive education programs, 
which he called "dumping grounds for children who need more and 
more literacy." 

"We train children for jobs that don't exist on obsolete equip- 
ment," he said. "Spend the time on learning. Spend the lime on 
things that allow children to win throughout their lives." 

Recommendations of the select committee will be considered 
by the state Legislature, which Is expected to convene in June for a 
special session. _ 
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99% of the honor graduates will be attending some form of higher 
education. 

Of those entering higher education institutions, only 10% re- 
ported that their course of study would he education. Business, engi- 
neering/sciences, and the medical field constituted 70% of the chosen 
areas of study. 

Asked if in the future they would consider teaching in public 
education, only 12% responded yes, 57% said no, and 25% said they 
would possibly consider it. 

57% of the students surveyed stated that they have at least one 
family mtmber presently in the teaching profession. 

The most common responses given as the reasons for entering 
the teaching profession was the sense of reward and their overall love 
of children. 

The most common responses given as the reasons for not en- 
tering the teaching profession were its low pay and general lack of 
interest. 

Data provided by the Texas State Teachers Association are presented in 
Appendix F. Texas had been in the lower ranks of states in its average compensation 
to teachers, although in 1982 it had climbed to the 25th. position. Far worse, 
Texas was ranked 43rd in its per-pupil expenditure for education. Salaries for 
begiiming teachers were believed to be more discrepant than were salaries at the 
median. Spokespersons for many educator groups reminded the Select Committee 
that neither teacher shortages nor the teacher quality problem could be solved 
without more pay. A typical example is the following quotation from testimony by 
the Association of Texas Professional Educators: 

While raising teacher salaries to acceptable levels is no panacea, it is 
an essential first step. No other reforms in our educational system 
will have any impact if we do not have qualified, dedicated profession- 
als in the classroom. Competency testing, more stringent certification 
standards, revision of the curriculum and improved discipline proce- 
dures will have nebulous impact on the system if the level of salaries 
one can expect upon becoming a teacher continues to be so low that 
fewer than 4% of our college freshmen will even seriously consider a 
teaching career. 

More than two-thirds of Texas' school districts predict serious 
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teacher shortages in the next five years. That is a serious problem 
which must be addressed. Money alone jjill not do it, but when college 
graduates can make 10 to 15 thousand dollars more their first year 
out, they are going to select private industry careers long before they 
will go into teaching. 

Concern about the quality of teacher candidates was naturally associated 
with concern about the qualifications of current teachers. Most observers felt that 
heightened suspicions about wide-spread teacher incompetence was closely tied to 
the SAT score decline (among students). In 1978, DaJlas Independent School Dis- 
trict had given the Wersman Personnel Classification Test of basic skills to 535 
first-year teachers and to a volunteer group of juniors and seniors from a private 
high school. The students outperformed the teachers; in addition, more than half 
of the new teachers fell below the standard set by the district. A lengthy article by 
Linda Austin in the Dallas Times Herald (12/13/83) included a long list of facts 
that were remembered by many of our informants. 

S8% of of Texas juniors failed the PPST (at its pilot administration). 

The PPST was also given to 3,300 new teachers in Houston 
ISD but only 2,400 scores were reported because of cheating and other 
irregularities. 62% failed the exam. The Houston school board later 
lowered the passing score sa that only 44% of the teachers failed. 

Bright teachers bail out first. The higher a teacher ^s score on 
the National Teacher Exam, the less likely the teacher is to be teaching 
seven years after starting. 

According to an ETS spokesman^ ^As retirement reduces the 
current teaching force by one-fourih to on^ half during the next decade, 
those filling the void will be people with SATs in the 300s-a generation 
of the most ignorant si dents who have (ever) gone into teaching. 

Vntil a decade ago, public schools could count on bright women 
to enter teaching because of the discrimination they faced in other 
professions. But with other careers now open to them, women are 
avoiding teaching, just as men always have, because of its low pay, 
poor working conditions, limited prestige and lack of upward mobility. 

In 1980-81, Texas issued 5,698 emergency permits for under- 
qualified people to staff classrooms because of teacher shortages. 

On the same date, Austin also reported that Dallas was hiring unqualified 
minority teachers because of a desegregation order. 
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The Dallas Independent School District hires low-scoring apjUcants 
as teachers, a disproportionate number of whom are blacks and His- 
pa'oics, because the district is under federal court order to increase the 
percentage of minorities on its faculty by 1986, Supt. Linus Wright 
said. 

More than half of the 1,182 new teachers hired in the past 
two years scored below 67 percent, the minimum ''acceptable score, 
on a high'School'level test of academic knowledge given as a pre- 
employment exam. And the majority of the low-achieving new teach- 
ers were minorities. 

Passing over higher- scoring whites, the district also hired a 
number of low-scoring whites to protect itself from charges of reverse 
discrimination, Wright said. 

Data about poor teacher test scores were augmented with personal stories. 
"The committee kept hearing that there were those teachers, however small the 
percentage may be, that should not be in the classroom. We heard all these horror 
stories of misspelled words on the bulletin boards." In the Dallas Times Herald 
(12/12/83), a teacher organization leader told about a Dallas high school teacher 
who made good grades in high school and collie but could not speak in complete 
sentences. "She couldn't write anything and couldn't do ' e simplest math. He 
went on to say that this same teacher did not know who Teddy Roosevelt was; she 
said he must have been an author of popular novels. Another story was retold by 
committee members all over the state. It had to do with a teacher in a second 
or third grade class who was trying to explain why the weather is so different in 
Alas^^a and Hawaii. "She couldn't explain it because Alaska and Hawaii are so close 
together; (you know how they pull Alaska and Hawaii out from the continental 
states and put them in a corner). They're so close together, liow could the weather 
be so different?" 

J>tatistics and stories about teacher incompetence where amplified by surveys 
of educa\ors, who admitted that some among their ranks were unfit. In addition, 
these surveys conveyed the added problem that current procedures were inadequate 
for removing incompetent teachers. The Dallas Times Herald sent questionnaires 
to 7,000 Dallas teachers. The majority of teachers responding answered that "at 
least one-fourth of their colleagues in the classroom are incompetent." (12/12/83). 
The firm of Sirota and Alper (1984) conducted interviews with a random sample 
of superintendents, principals, and teachers. Although more than one hundred 
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questions were asked, the following two questions were among the most salient to 
committee deliberations: 

Q» 118 There has been a lot of discussion in the mt *a about 
teacher competence. Some feel this is a serious problem, 
while others feel it has been greatly exaggerated. What is 
your feeling? About what percentage of teachers at your 
campus wouid you personally rate as unsatisfactory? (Su- 
perintendents respond in terms of your district as a whole.) 

0%l-5%6-10%ll-15%16-20%21-25%>25% 

Superintendents 7 62 19 6 4 2 1 

Principals 27 51 15 4 2 0 0 

Teachers 20 52 15 6 3 2 2 

Q. 55 At my campus, it is difficult to get fired for poor 
p*»;formance. 

Disagree Neutral Agree 



Superintendents 


51 


12 


36 


Principals 


54 


18 


29 


Teachers 


33 


27 


41 



The results were summarized in the American Statesman, "Most teachers and ad- 
ministrators estimated that only 10 percent of their colleagues are incompetent. But 
both groups agreed it is hard to get fired for poor performance on the job."(2/lC/84) 
Several key participants recalled that it was educators themselves (through 
these surveys) who had convinced the Select Committee that outside intervention 
was necessary to remove bad teachers. 

One of the things that survey found was that invariably almost every 
teacher that responded said they knew a few people in the profession 
that simply didn't have the skills to do the job. There were people out 
there that were semi-literate and should not be in the profession. Bui 
the profession was not purging itself ^ r whatever reason. Teachera 
then, with that kind of response, directly impacted the Select Commit- 
tee's decision to have a teacher test. I don't think that teachers realize 
that the tea r test came from teachers themselves. 
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We have roughly 200,000 professionals employed in this state. Vm 
sure there are a few that probably shouldn't be there. ( The Commit- 
tee) would get on to the issue of why we are not doing a good job of 
removing them from our ranks. The discussion would focus on the 
adequacy or inadequacy of the teacher evaluations, and politics, and 
the difficult legal issues of removing someone that was not fully com- 
petent. It was very difficult to remove someone; it was either very 
difficult or distasteful. 

Although there was a procedure for firing teachers, for some reason 
they weren't being too effective in some of the school d'stricts. It was 
really hard to get rid of some of the teachers after all the red tape. 
Some of the Select Committee members certainly didn't think that it 
was a good thing that these types of teachers were out there. I want 
to stress that bv all means they were not the majority of the people 
teaching. But there wert some teachers in the classroom that didn't 
have adequate communication skills. 

Very early on, the question of competence and salary increases were linked. 
On the one hand, j.;3iif.t3e members accepted the xogic that current problems of 
incompetence would only worsen unless, in the future, higher salaries existed to 
attract more academically prepared students into teacliing. But, given the horror 
stories, the committee was unwilling to recommend a pay raise that would benefit 
both competent and incompetent practicing teachers. As some form of testing 
became a more common expectation among committee members, it was reported 
that, "requiring competency tests for teachers would rid the public schools of 20,000 
incompetent instructors." {American Statesman, 3/15/87). Although estimates of 
the numbers of incompetents ranged from 5% to 30%, the most common magnitude 
used by Ross Perot and others was the 10% figure, derived from the Sirota aiid 
Alper report. For example, in the Amarillo Globe-Times, Perot was quoted as 
paying that "Any level of incompetence in the classroom is unacceptable because 
of the number of children harmed. If 10 percent of the teachers in the state are 
incompetent, 300,000 children are affected." (4/24/84). 

An analysis of "The Constitutionality of Teacher Competency Testing" was 
obtained from a Dallas attorney, David Bryant. Based on legal precedent lie con- 
cluded that practicing teachers could be subjected to a test so long as the following 
conditions * '^re met: 

1. the tests must be non-discriminatory on their face and in purpose. 
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2. the tests must be properly validated, with reasonable passing scores. 

3. the tests must be fairly administered and scored. 

4. fair advance notice of the tests and fair opportunity for retaking 
anc^ remediation should be provided. 

5. those whose certificates or jobs are to be affected should be afforded 
the basics of procedural due process, including notice and an opportunity 
for a hearing before such effects occur. 

6. the sanctions for failure of the tests should be uniformly, and not 
selectively imposed. 

Bryant did not beheve that these conditions would prevent legal challenge, out that 
"a testing system meeting these requirements would ultimately be upheld." 

In February 1984, two months before the Select Committee produced its 
final report, the results of a Texas public opinion survey were released. The Texas 
Poll is funded by Harte-Hanks Communications and conducted by the Public Policy 
Resources Laboratory at Texas A M University. The majority(72%) of Texans 
were in favor of increasing the tax on alcohol and tobacco to "make more money 
available for pubhc schools." The vote was split 45%-55% as to whether tb? general 
sales tax should be raised for the same purpose; and the great majority were against 
raising property taxes or the gasoline tax. In the same survey, Texans were asked 
about testing as well as other school issues. 

By a 9'tO'l mcLTgiUj Ttxaus went teachcTS to pass coTupctcucy test 
before they are allowed in th^ classroom*.. They also say by the same 
' nded t Vy that high school seniors should pass competency tests 
they ca.i cet diplomas. 

K Jo ^qvl think that teachers in Texas should have to pass 
a competency test before being certified to teach in public 
schoolf/? 

Yes iWo No 10% 

Q. Should high school seniors be required to pass a compe- 
tency test belcrc they are given their graduation diplomas? 

Yes 87% No 13% 

Although the particular question about teacher testing referred to a test prior 
to certification, we believe that publicity surrounding the survey results contributed 
to the impression that the general public was strongly in favor of a test for practicing 
teachers. Participants recalled to us that the public was very supportive of TEC AT, 

The Select Committee released iic report on April 19, 1984. Recommenda- 
tions to increase the base pay for teachers and to institute teacher testing appeared 
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on the same page (among 44 pages of recommendations). The committee's proposal 
included both subject matter tests and a basic skills test. These tests were to be 
a one-time requirement for teachers and administrators in the public schools. Fair- 
ness measures such as equal opportunity, preparation and remediation, and multiple 
retakes, were to be provided. 

Special Session of the Legislature 

On May 25, 1984, Governor White called a special session of the Legisla- 
ture for June 4, for the purpose of enacting a "comprehensive reform of primary 
and second \ry public education, including revision of school finance structure, and 
increased compensation and career inducements for public school teachers/' Sev- 
eral competing drafts of legislation had already been circulated; the special session 
would permit 30 days for differences to be resolved. The early version of Represen- 
tative Haley's H.B. 72 did not include either establishment of a new appointed state 
board of education (a reform considered essential by Perot) or testing for current 
teachers. The Governor had, however, included teacher competency testing in his 
annoimced plan for reform. Two other bills introduced at the same time reflected 
the major points of disagreement among key legislators. Senate Bill 1 by Ppjker 
did not include the most controversial provisions; S.B. 4. was called the SCOPE 
bill because it carried the full recommendations of the Select Committee. These 
differences were the focus of debate during the special session*: 

(S.B. 4) Minimimi salaries for tesurhers tied to career ladder levels 
vs. (S.B. 1) Single-line minimum salary schedule 

(S.B. 4 only) Limits on class sizes in primary grades 

(S.B. 4) Basic skills and subject area exams for teachers and administrators 
vs. (S.B. 1) Minimum skills assess, aent for those personnel 

(S.B. 4 only) Full-day kindergarten, student tutorials, parenthood education 
classes, and child-care education curriculum 

(S.B. 4) Student passing grade (70) in all courses in order to participate 
in extracurricular activities 

vs. (S.B. 1) Less restrictive measures for limiting extracurriculars to the 
academic school day 

(S.B. 4) The appointment of a 9-member state board 

* This analysis is taken from notes on the history of H.B. 72 provided to us 
by Dr. Terry Heller, Research Specialist for the Senate Education Committee 
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vs. maintaining the elected board 

Teacher testing, then, was one of the hotly contested items in the special 
session. Before elaborating on the substance of that debate, we will mention several 
other important provisions of the final H.B. 72, especially the winners and losers on 
ether controversial points. Haley's second draft of H.B. 72 already reflected some 
compromises; other compromises were hammered out by a conference committee 
and a midnight session of the leadership. In the final legislation, teacher starting 
salaries were raised to $15,200 and additional salary supplements were tied to a ca- 
reer ladder. Class size was to be limited to 22 in the early grades. Current teachers 
and administrators were to take both subject matter tests and a basic commu- 
nications test. The state would fimd half-day kindergarten. The more stringent 
control over athletics, the famous "no pass, no play", requirement was included. 
And, Perot's sine qua non, an appointed state board to take control away from 
the education establishment, was enacted. Other less controversial aspects of the 
legislation included a 175-day school year, seven-hoxu- school days with fewer in- 
terruptions, a high school graduation test, and an end to social promotion. State 
funding of schoob was to be computed using a formula based on average-daily at- 
tendance; more importantly, districts which fell below 110% of the state average 
wealth would receive enrichment equalization funds. 

Stories about some incompetent teachers continued to circulate during the 
special session, as they had during the Select Conunittee hearings. Especially, 
there were stories about letters from teachers lu-ging legislators to pass a pay raise 
that were illogical and illiterate. Legislative aides also told us that the lack of 
professionalism on the part of some teacher representatives (the way they spoke 
or what they argued for) caused legislators to think less well of teachers. Those 
who argued for a teacher test, wanted a one-time screening to get rid of these 
incompetents. 

Bill Haley, a teacher himself, had not wanted a test. never supported 
the test. The test was in the bill because I was carrying a compromise^ alternative 
piece of lepislation.^ knev)^ when I started^ that I was going to lose (on) the test. 
Everyone knew that. It was a foregone conclusion.'' ^My attitude was that there 
are teachers who may not get past the test^ but I would want my children in their 
class. I know others who could knock the top off the thing^ but I wouldnH have my 
kid in their class. I know some teachers who had lots of difficulty with it^ hut I want 
my kid in their class. The point is^ it turned out to he a measure of literacy^ not 
competency. " 
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In the Senate, Carl Parker had prevailed in keeping a teacher test out of the 
draft legislation. He called it the full employment bill for lawyers. The following 
quotations are excerpts from Parker's address to the Senate Committee of the Whole 
on June 21, 1984: 

We^re talking about whether or not we^re going to use teacher testing 
as a punitive tool or we're going to use it as a management tool to 
try to make education better. (Parker thought that a test could be 
available to local districts to be used with teachers whom supervisors 
felt were in need of remediation. ) 

Now, I personally believe from my personal observation and talking to 
teachers and seeing schools, that the vast majority of the people who 
are teaching our children are teaching them just about as well as we 
will let them and equip them and want them to. Some people would 
put all of the blame for whatever shortcomings public education has on 
teachers. And yet, there is pier: »f blame to share between a tight- 
fisted legislator, a near-sighted administrator, doting parents, parents 
that don't care.... We all share in the blame. 

Somebody tell me how you can draft a test to tell you how to be a good 
Senator. You canH dp it Somebody tell me how you can devise a test 
to tell you whether or not someone is an able kindergarten teacher. It 
can't be done. Now, you can test specific abilities but you^re going to 
have to draft a muitHude of tests. The test to test the skill required 
to teach fourth grade arithmetic certainly is not the same as the skill 
required to teach seventh grade arithmetic. 

....We're going to give a test to see if they can add two and two and 
four and four and, if you can do that well then you can go back to 
teaching Calculus. We will have insulted every math teacher in the 
state and we will not have improved the quality one iota. 

Senator Farabee's response expressed the sentiment which ultimately more 
legislators shared. First, the test was a safeguard against local administrators who 
had thus far failed to remove incompetents. Second, Parker's concern about the level 
of the test applied to the subject matter tests, but not to a basic communications 
test. 

/ very much feel that it would be better to ha^^e one test because-here 's 
the problem. I think that if iVs left to the option of the Board or 
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the option of others, then there always a tendency to say, don't 
want to make him or her mad. Vve known them all my life, they're 
good friends. Let's just wait another three years and they'll retire or 
maybe they'll he moved to some other school... The good thing about a 
test, one time given and with an additional opportunity to take it, is 
that it is done without invading the classroom. It is done without the 
brother-in-law element. 

There are two areas. One is just communication. Basically, even if 
you teach Algebra, you do have to be able to communicate in writing 
and to have basic spelling and literacy and to be able to read, even 
if you teach Algebra. Then, there's your subject area which might 
be Algebra, which might be Calculus or it might be first grade and 
learning the ABC's. 

Eventually, debate about the feasibility and desirability of testing teach- 
ers took a back seat to poUtical realities. At least 2C of our interviews with key 
participants included the bargain that was made to leverage a tax increase. The 
slogan became, "no test, no tax." We have noted, in earlier stages of the reform, 
that implicitly talk about salary increases was paired persistently with the need to 
demonstrate competence*. Dtiring the special session the quid pro quo was made 
explicit. The "no test, no tax" rallying cry was attributed first to Stan Schlueter, 
Chairman of the House Ways and 2vleans Committee. Some suggested that his mo- 
tive was to forestall both; i.e., given that the test was so aversive a measure, neither 
th« test nor the tax increase wotdd stu^ive. The slogan was taken up by others, 
however, who wished to see both succeed. As the Commissioner recalled: 

Education got more than a billion dollars out of the tax bill (annu- 
ally). For them to sell the people of Texas on a tax bill, they had to 
(convince) the people that they were going to get something in return. 
So they had to sell them on improved education; one piece of that im- 
proved education was that they were going to test every teacher. They 
were going to get rid of the teachers that didn't have the skills to do the 

* We noted this association, however, after having been sensitized to it by our 
first interviews with key participants, who were recalling events in the last days ol 
the special session. Many made it seem as if the no test-no tax ultimatum was 
delivered for the first time in the special session. But once alerted to the theme, wp 
found it in political rhetoric dating back several years 
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job. So, the teackcT test was in fact a price paid by teachers. That was 
the price the legislature decided teachers would pay for higher salaries 
and for a lot more money to be spent in public school education. 

And as remembered by a legislative aide: 

The ''no test, no tax^ came to be and Mark White got stuck with it 
He had to deliver the pay raise and he couldnH deliver the pay raise 
without the tax bill and he couldn't deliver the tax bill without the test. 

In the words of a teacher organization representative: 

It was almost that the competency test was the price that teachers had 
to pay to get a pay raise. 

Although Senator Parker had resisted large-scale testing of teachers, he character- 
ized the momenttmi for the test similarly: 

A lot of politicians were caught in a bind of promising the teachers 
better salaries and having to face a constituency that was enamored 
with the Proposition IS jyndrome-no new taxes or reduced taxes, even 
though Texas ranks near the bottom in per capita taxes of all the states. 
It takes a rather courageous candidate to lecture his constituents and 
try to educate them. I think that they caught on to a way to deal with 
that. (They said,) Tm for doing whatever is necessary to reward 
teachers but I donH want to reward those that arenH competent We're 
going to put some tough measures in place to make sure that we only 
reward those who are really superb teachers''.... I just think they were 
putting a face on the request to extract more funds from folks by saying, 
''we 've gotten our pound of flesh from the teachers in return. " 

During the 30 days of the special legislative session, complicated political 
forces produced a complex, onmibus reform bill and a $4.6 billion tax package. 
Our analysis cannot ?idequately portray the process by which the final character of 
the reforms was determined. The process cannot be reduced to a series of single- 
issue votes; nor were compromises or trade-offs always explicit. Although various 
analysts said that the prognosis for major reform had been bleak at the start of 
the session (Burka, 1984; Texas Observer, 7/13/84), in fact, there was tremencous 
pressure to produce something after all of the attendant publicity. Haley's bill had 
momentum; great political pres^-ure was exerted by the Speaker in the House and by 
Parker and Hobby in the Senate to keep any differences of opinion from derailing it. 
As for the matter of teacher testing, although it was hotly debated and educators 
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lobbied strongly against it, support coalesced for a final reform package with tests 
foi current teachers in it. 

Teacher Organizations 

Teacher organizations in Texas had a different view of "competency test- 
ing" than that held by legislators or the general public. Beginning with the Select 
Committee hearings, they voiced their objections. Although the the four major 
teacher groups at sometimes disagreed with each other, generally they were sup- 
portive of testing teacher candidates but were not in favor of tests for practicing 
teachers. We will use several lengthy quotations to represent the organization posi- 
tions. Primarily, testing of current teachers was unacceptable because competency 
could not be measured with paper and pencil tests. Secondarily, some groups ar- 
gued that teachers should not be fired for the inadequacies of teacher education 
programs or feckless administrators. Instead, teacher groups were in favor of eval- 
uations conducted through classroom observation, and of assessments that resulted 
in remediation rather than being fired. The excerpts below are taken from testi- 
mony presented to the Select Committee. Note that in the course of presenting 
their positions, organization spokesperson's explicitly agreed that some practicing 
teachers were incompetent to do their jobs. 

The following portion, most relevant to competency testing, was taken from 
the statement of the Association of Texas Professional Educators, made to the 
committee on September 14. 1983: 

Those of you in industry recognize the need to reward employees for 
the quality of their job performance^ and for the level of expertise ttiey 
can demonstrate in the execution of their duties. Teachers should he 
no different If you pay teachers higher salaries, it is not unreasonable 
that you would expect a satisfactory level oj qualifications and skills. 
Those of us who take the profession very seriously do not quake at 
the thought of having to pass a competency test or being required to 
study harder in our preparation programs. But we do have specific 
recommendations about how those two considerations should be im- 
pleme^Aed. 

First, competency testing. You cannot honestly expect a teacher who 
has been inadequately trained and educated to pass such a test. At the 
same time, you place yourselves on the horns of a dilemma. Those, 
teachers who make the headlines today because they con,not read or 
write, or because they know precious little about their subject aica, 
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did not become functional illiterates overnight. Somewhere along the 
line a state accredited institution of higher education told them that 
they had successfully passed all the requirements necessary to become 
certified teachers in Texas. Somewhere along the line, university pro- 
fessors in those accredited colleges and universities gave them passing 
grades for successftd completion of the work required. And, at some 
pointy the State of Texas concurred by issuing a certificate. 

Every teacher who graduates from one of these colleges of education, 
and who receives state certification, should rightly feel that they have 
what it takes to be a teacher - because the colleges and universities told 
them that they did. Even more so, school districts have hired them - 
consistently - and have never terminated them for ineptness. With 
such positive reinforcement, it is only logical for the. i to conclude that 
they were ready, and prepared, and knowledgeable enough to teach our 
future generations. 

Competency testing is a fine measure to ascertain whether teachers 
have kept up with the progress in their chosen fields. It should not, 
however, be used solely to- eliminate incompetent, teachers. We ac- - - 
knowledge that there are some incompetent teachers in the classroom. 
A competency test would certainly help pinpoint those deficient teach- 
ers. But rather than use it to oust them, in effect telling them that 
they have been lied to all these years, the test should be used to point 
out deficiencies so that programs for correction can be set up. If these 
deficiencies should have been remedied before a particular person had 
received a diploma and/or certification, then perhaps it should be the 
responsibility of the college and/or university from which that person 
received a degree to correct the problem. 

On the same date^ the following statement was made by Susan Crocker, Legislative 
Committee Chairperson of the Texas Classroom Teachers Association. 

As is evidenced by the massive revamping of the certification system 
and the rewriting of certification requirements, our present method 
of screening and ascertaining that individuals are ready to enter the 
classroom is not uniformly successful in sifting out bad risks and plac- 
ing those best suited to teaching in classrooms across our state. Fur- 
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iher, there ia Utile guarantee in the proposed changes that the situation 
will improve with regard to i,uch determinations. 

As a profession, we agree that certain minimum competencies are nec- 
essary for all candidates interested in entering the teaching profession 
and that a competency test is one measure to assure that such min- 
imum competencies have been attained. However, unless and until 
more training time is spent in actual school and classroom settings, 
after sufficient subject matter preparation is acquired, beginning teach- 
ers will continue to enter a profession ill prepared for what actually 
lies ahead of th em and is expected of them. Internship programs should 
be a part of preparation with an up or out provision available at the 
completion of each stage of development. 

The next stage of the development of teachers should begin only after 
careful evaluation of competencies exhibited and progress made. Un- 
successful candidates should have counseling services available to them 
with avenues open for redirection or remediation and retesting if de- 
sired. Such evaluations and determination should be made by qualified 
teachers as well as university and regulatory agency staff. Reliance on 
any form of a standardized test as the major or primary component 
for making these career determinations is unsatisfactory, because the 
skill of individuals to convey their subject matter knowledge to others, 
the essence of teaching, can best be judged by consistent and regula-r 
observation of the practice. 

Later, in February of 1984, when a comp-^tency test was specifically recom- 
mended by the Teaching Profession subcommittee. Dale Young, president of the 
Texas State Teachers Association, made the following remarks, reported in the 
American Statesman: 

One proposal we've heard advocates testing literally all Texas teachen 
by use of some as yet unspecified standardized test. The Educational 
Testing Service, originators of the SATs and the nation's largest test- 
maker, has said it does not have a test its experts deem suitable for 
measuring the skills of practicing teachers. In fact, ETS refuses to 
allow its tests to be used for that purpose. 

Young said the association realized that many teacher evaluations 
presently are not performed on a routine basis or are performed im- 
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properly %ui to compensate for thai by trying to decide whether or 
not teachers can teach from the results of a quickie exam is absurd. 

It is equally absurd to suggest that principals canH simply tell us who 
is literate and who isn't by just looking at the blizzard of paperwork 
teachers submit every day. " 

In their public statements, organization officials implicitly or explicitly agreed 
to the bargain that made testing a condition of a pay raise. In his introductory re- 
marks to the Select Committee, Dale Young said, ^We also know that many of you 
seek to tie those admittedly needed salary increases to proof of good performance. 
We are willing to deal with that need^ too.^ Although, in this context he was agree- 
ing to evaluation rather than a test. The ATPE testimony quoted above, linked 
higher salaries with expectations for satisfactory performance. After testing was 
adopted by the Select Committee, John Cole, president of the Texas Federation of 
Teachers, was quoted in the American Statesman: ^As a condition for a pay raise, 
there apparently will be a test imposed. '^{3/ lb 

During the special session, lobbyists for teacher groups continued to protest 
teacher testing but eventually agreed to it because of the "no test, no tax" 
ultimatiun and other provisions of the legislation. On June 21, 1984 the four teacher 
organizations signed a letter urging House members to vote for H.B. 72: 

Although there are elements of the bill with which we strongly disagree 
and we will continue to work to change H.B. 72 as it continues through 
the legislation process, the legislation taken as whole is beneficial to 
education. 

This was an agreement to live with the test. As reported in the American Statesman 
(6/24/84: 

The teacher groups were told that the train wa^ on the track and trav- 
eling at 100 mph. (Speaker) Lewis told them he would put in the bill 
the career ladder and minimum salaries teachers sought if they would 
agree to endorse the bill, even though it contained tests for teach- 
ers and other things they didnH like. Otherwise, merit pay would be 
rammed down their throats. 

In another Statesman article, headlined ^Teacher tests accepted grudgingly, Dale 
Young was quoted as saying that accepting teacher testing was part of a compromise. 
^We had to weigh bad things (testing) against wor.^e things (merit pay).^^ 
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The accord between teacher groups and lawmakers was shortlived. On June 
21 the House passed its version of the reforms, on June 23 the Senate version was 
approved; differences were to be lesolved by a co.iference committee. New changes 
in the career ladder and salary provisions were great enough to cause three of the 
teacher groups to withdraw their support of the legislation. Late in the evening 
of June 27, Lt. Governor Hobby "banned the Texas State Teachers Association 
■from his office after tht group refused to retract a press release that denounces 
the education reform package. "(American Statesman, 6/28/84) The leaders of the 
House and Senate believed that these three organizations had reneged on a promise, 
causing disrespect for the union leaders that was still heard in interviews two years 
later. Some suggested that TSTA leaders were looking for an excuse to withdraw in 
a huff, that it was a ploy to attract new members to the organization. Conversely 
organization representatives told us that the benefits of the bill had been so watered 
down, that they were no longer worth the negative conditions they had been forced 
to accept. The following are recollections from two different teacher representatives: 
We had tentatively agreed that if certain things came out of the bill 
a certain way, we would be for it. And when they didn't come out 
thai way we withdrew our support. They took away the grievance 
procedure.... They wrote a new bill in three or four hours over there. 
They took out a lot of the good things. 

What was needed was an across the board raise for everv tea^ner in 
this state and it certainly didnH happen under House Bill 72. They 
put $4,000 increase on the front end for the beginning teacher but that 
%4,000 didn't carry throughout the system. There are many teachers 
in this state that didn't get any raise. There are a lot of them that 
got very small raises and these are experienced teachers you're talking 
about, the ones that you've got to keep in the profession, the ones that 
are leaving now in droves. 
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/ think when they first started talking about (pay raises) it was going 
to affect all teachers. It was going to be an across the board blanket 
pay raise. Then when the bill went to a conference committee and 
compromises were made and deals were struck, it came out that the 
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veteran teachers could (only) get a raise if they were put up for merit 
pay- 

The only teacher organization which remained committed to the reform was 
the Texas Federation of Teach s. President John Cole recalled to us his own version 
of the test- tax bargain: 

We had an opportunity to do something because of some extremely 
quirky situations, like Ross Perot getting involved. We could get that 
legislative body to vote a tax increase in an off legislative year and 
a very progressive funding mechanism for schools, where previously 
we had a very regressive funding mechanism. In addition, we had 
an opportunity to get something in our pockets before the great crash 
occurred. We could see, some of us, that the oil industry wrs already 
sick. I donH think any ofv/ ^vould claim to have seen the days of $8.00 
a barrel oil; but we were noticing that times were getting tough for us 
and some of us thought that it tjas time to do what is necessary to 
get what we could for education while the getting was good. It sounds 
awfully crass but this is the way these things are done sometimes. If 
going along with a test meant getting that, maybe thaVs what we ought 
to to do. That was the decision we made. As a result "vmc %S billion 
extra dollars was put into the pubUc Schools,"mdre importantly, it was 
reallocated in places (where there was the greatest need). 

His rec ^lection of the TFT's split from the other organizations continued in the 
same vein. 

We kept consistently feeling that, if we didnH get what we could, our 
chance was not apt to come around again. With the economic situa- 
tion looking the way it was, and with a unique set of circumstances in 
place, we felt that . Is was the time we had better get this bill passed. 
So we chose not to drop out of support for the reforms. 

The day after the brouhaha in the Senate offices, John Cole supported the reform 
legislation at the Governor's press conference. 

Our study of political events did not focus on the period between the enact- 
ment of the law and the implementation of TEC AT. However, union activities were 
intense during this time, involving three major foci: attempts to revise or rescind 
the testing provision during the regular session of the legislature in 1985, lawsuits 
challenging the test or its implementation, and efforts to prepare teachers for the 
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test. Teacher review and preparation workshops will be treated in depth in a later 
section of the report. We will discuss the other two organization activities here 
briefly. 

In January of 1985, Senator John Sharp held a joint press conference with 
The Association of Texas Professional Educators to announce the filing of Senate 
Bill 103. Had it been adopted, basic literacy testing would have been removed 
except for those teachers who were identified as deficient through the appraisal 
process(a separate evaluation provision of H.B. 72). In testimony to the Senate Ed- 
ucation Committee, February 27, 1985, Sharp argued that every piece of legislation 
should be viewed through "^the lens of available revenue. " Using Perot's figure that 
approximately 10% of teachers were the object of the testing, he felt it was wasteful 
to give the test to everyone: 

We know for a fact that 90% of the administration costs which we, 
as legislators^ must approve, will be spent giving tests to people whom 
we know donH need to take them.. ..We can save about $11 million in 
administration costs through the enactment of S.B. 103-and that can 
buy a lot of things besides an unnecessary test 

Also speaking in favor of the bill, Mike Hardin, President of the Association of 
Texas Professional Educators, said that two-member appraisal teams would stop 
the problem "bf local districts renewing- th^ contracts of illiterate teachers. ^^The bill 
allows two-member appraisa*, .eams to determine whether there is probable cause to 
doubt the basic skills cf a practicing educator. It then permits the person in question 
to receive remediation and test preparation. ^ 

In August of 1985, The Texas State Teachers Association filed a suit to pre- 
vent the testing of practicing teachers and a'^ministrators on the grounds that the 
test violates lifetime teaching certificates and the probibition in the state constitu- 
tion against retroactive laws. On March 3, 1986, one week before the administration 
of TEC AT, Judge Harley Clark ruled that the test was constitutional and that the 
administration could proceed. In February of 1986, the ATPE initiated a suit to 
prevent school districts from firing teachers on the basis of their first test scores 
without benefit of the June retake. (The Texas Education Agency sent test results 
to individual teachers rather than to employers as a orotection of privacy. Some 
orgL^ization leaders encouraged their membership to withhold paesing results until 
after the retesting date so that second-time passers would be indistinguishable from 
other teachers.) In loccd actions, individual teache. * sometimes won injunct:ori£> 
against taking the test. Thirty-nine teachers were granted a permanent injunction 
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in Laredo; a 30-year special-education supervisor was exempted in Jourdanton, as 
was a auto mechanics teacher in Dallas. 

Media Portrayal of Teachers 

Many of our interviews with public figures and legislative aides included 
disparaging characterizations of how teacher leaders had acted during the special 
session. Senator Parker, who had vigorously opposed teacher testing, said, "7 have 
told teachers since then that the legislature's folly has been exceeded only by the 
teachers' folly and their reaction to this/' We mentioned this conflict in the pre- 
ceeding discussion, but worked actively to remove the negative coloration from the 
description of imion activities. Subsequently, however, a major theme emerged from 
our interviews with a representative sample of Texas teachers. Many, many teach- 
ers lamented how embarrassed they had been by the portrayal of teachers in the 
media. These teacher perceptions are summarized in a later section. Alerted to 
this issue, we also went back and conducted a content analysis of the newspaper 
documents we had collected. How were teachers represented in news stories leading 
up to TECAT? 

We have already belabored one dominant theme, i.e., that some significant 
number of teachers and administrators in Texas schools were ^aid to be incompetent. 
>ome good things were said about teachers but these statements were rare and never 
iade the headlines. For example, in aji Amarillo News- Globe editorial ((5/21/84) 
supportive of ^rattl[ing] a few cages of schools of education Perot was quoted to 
say that he distinguished between currently employed hard-working educators and 
the imintelligent students now preparing to be teachers. Perot also acknowledged 
that the level of incompetence in teaching was proba^'y no greater than in any 
other field, but that in teaching, any level of incompetence was intolerable, because 
it affected so many school children {News-Globe, 4/24/84). Figure 3.2 is an example 
of an editorial cartoon published during the Special Session. 

A second theme in newspaper stories had to do with the unprofessioncti- 
ism of teachers. They were portrayed as self interested and anti-reform. Often 
rhetoric supporting the test-tax trade off, suggested that teachers had to be forced 
to agree to improvements along with salary increases. An American Statesman 
article reported that Perot vowed to ^spend as much as it takes to battle an emerg- 
ing alliance of educators who want a teacher pay raise and little else."(4/ll/84) 
Perot characterized education associations as cither ^^interested only in getting a 
pay raise" or, at best supportive of change but ^reluctant to challenge the board (of 
education) and be left in an awkward position if they lose. " Twice later, the Austin 
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Figure 3.2 

Editorial Cartoon Published During the Special Session 
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paper reported that Perot alleged that ^some Texas teachers are giving grades in 
exchange for letter opposing education reforms.'' (4/17/84)(5/9/84) Perot called 
education lobbyists ^'pickpockets' who want taxpayers to 'send more money but 
skip reform'. ''(American Statesman, 4/17/84) As an American Statesman reporter 
summarized, ''Perot, with few exceptions, paints the education establishment as the 
main opposition to change. You basically have 200,000 educators saying, 'send more 
money'." (5/9/84) On the second day of the special session, the American States- 
man reported on a rally at the Texas State Teachers Association, where teachers 
'^cheered when Parker said teacher pay is the top priority of the special legislative 
session. " The article also included a warning from Representative Bill Haley urging 
teachers to ^work for the Wuole education package and not just their pocketbook is- 
sues ^ ( 6/ 5/84)' This view of the Texas teacher as interested only in money is, in our 
opinion, an especially damaging portrait of educators. Teachers, of all professions, 
are expected to work out of a strong sense of service and to be deeply concerned 
with the educational welfare of children. 

Latei in the special session, teachers groups were again cast as mercenaries 
when they lobbied against equalization. As the American Statesman explained, 
'^Because at least 75 percent of all state aid is for teacher salaries, the finance 
issue divides teacher groups and equalization forces. The state money can either 
• ie spread xquatly among all the teachers of the staU or be' shifted toward poorer- 
schools. "( 6/19/84) Often the tone of articles featured teachers in a pitched, defen- 
sive battle, trying to the prevent the reforms that would be done to them. They 
had to work constantly to '^blunf comnromises regarding their pay raise (Ameri- 
can Statesman, 6/20/84). They were against equalizati*^-^, against merit pay, and 
ag^nst competency tests. They appeared uncooperative, becoming ''reluctant al- 
lies " in support of the House Speaker's bill only under '^threat of a merit pay amend- 
ment" (American Statesman, 6/19/84). Articles which mentioned the unions' anti- 
merit pay stance did not always mention what unions favored-a pay schedule bared 
on longevity. 

Another unflattering characterization of the four major tea'*^ jv organizations 
emerged in the special session coverage: they were neither unified nor consister^. For 
example, the Amarillo paper, which made only slight mention of unions in their cov- 
erage of the session, referred to them as "groups that frequently disagree ^"(6/22/84 ). 
When the four organizations managed to agree, it made the news in Austin in an 
article entitled "Teacher unity" and subtitled "Four rival groups join forces beh^Tid 
education bill. " The American Statesman reporter hailed the agreement as ihow 
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of unanimity that was once rare for organizations that often squabble among them- 
selves.'' Even then, only the Hhreat posed by JT Ross Perot'' and the ""stubborn 
insistence by Lewis" motivated the pact among the groups, who in Bill Haley's 
words, ""compete over control of issues" (6/24/84). Only four days after the rare 
show of unity, three of the four groups withdrew their support from the education 
bill. The next day, another article reinforced the image of teacher groups as not 
imified. ""While the Texas State Teachers Association leaders at the state level re- 
jected the education package.... the votes to increase funding to Austin schools made 
the reform bill reluctantly acceptable to the local branch of the group" (American 
Statesman, 6/29/84). 

Teacher organization surtions could possihly have been interpreted through- 
out the TECAT coverage as capricious. One month a headline ran ""Teacher 
organization calls testing proposal absurd" (American Statesman, 2/22/84), the 
next month, ""Teachers claim pay raise plan is too general" (American Statesman, 
S/3/84), and the next month, ""Teachers back Perot plan" (American Statesman, 
4/17/84). These three s^arate articles considered the views of three different 
unions. To a reader who only skims headlines, teachers woidd seem to flip-flop on is- 
sues. Similarly, on August 17, 1985, ""Chief of union urges hard test in teacher quiz" 
titled an article about the Texas Federation of Teacheis {American Statesman). 
L^s'than two 'weeks* later, another" article stated, ""Teacher group files challenge- 
to testing," this time concerning the Texas State Teachers Association {American 
Statesman, 8/S0/85) 

The seemingly mercurial withdrawal of support for the reform bill was un- 
doubtedly the single most harmful blow to the image of tesichers. It csu^ried with it 
the connotation of unethical as well as capricious behavior. One senator who had 
fought for the teacher raise, felt as if he had been ""stabbed in the back" (American 
Statesman, 6/29/84)- Another senator told reporters that the union action was 
""shortsighted, selfish, and insulting" (American Statesman, 6/29/84)- In our inter- 
views two years later, the .nost cited symbolic event was that of the .nild-mannered 
Lt. Governor physically shoving the TSTA representative out of his office. 

Becky Prooks, President of the TSTA, said that her group had withdrawn its 
support for the bill because ""we were forced into competency testing and merit pay"^ 
(American Statesman, 6/28/84)\ yet only four days earlier, the same group had 
acknowledged that ""accepting teacher testing was part of a compromise" (Ameri- 
can Statesman, 6/24/84). Not only did the Texas State Teachers Association back 
out, but they backed out ungracefully. Becky Brooks' comment, ""Even a dog knows 
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the aijference between being stumbled over and being kicked'' (American Statesman, 
6/28/84) J evoked an ugly image, base and snarling. The phrase was remembered 
often in retrospective interviews. It expressed a venomous anger that was undoubt- 
edly at odds with the public's view of how teachers should behave. 

Between the special session and the test administration, the press frequently 
reported on the teacher test. The American Statesman tile contained 22 articles 
about the test in 1985, and another 30 in the first four months of 19S6. For example, 
progress in test development, or debates about cut-scores were covered. Occasional 
articles, such as ""Half flunk entry tests for teachers'" (News-Globe, 11/11/84) 
""Mock competency test flunked by half" (American Statesman, 1/20/85) explicitly 
repeated the teacher incompetence theme, but no voice as salient as H. Ross Perot's 
regularly questioned teacher ability. In fact, the chairman of the State Board of 
Education, Jon Brumley, and State Education Commissioner William Kirby were 
repeatedly on record with the opposite message. For example, Bnualey expressed 
confidence that the test would ^catch^ most of the ^few teachers out there who 
are incompetent from a literacy sense"" (American Statesman, 2/10/85), and Kirby 
asserted that Hhe vast majority of our teachers will have no trouble demonstrating 
their reading and writing skilb"" (American Statesman, 9/13/85). 

Teacher union activities before the test were extensively covered in the Austin 
newspaper and covered only somewhat less so in the Amarillo newspaper. More 
than the words or actions of any other group or individual, the teacher organization 
actions, at least in the files to which we had stccess, ^ost strongly shaped the 
representation of teachers in the press for that period. The two newspapers reportec 
on the following ^teacher"" activities: 

-November 1984: -The Texas State Teachers Association (TSTA) vows to 

battle the tezurher testing law {News-Globe, 11/6/84). 
-January 1985: -The Association of Texas Professional Educators 

(ATPE) and the TSTA push in the legislature for the 
repeal of the competency test {American Statesman 
1/31/85, News- Globe, 1/7/85). 
-June-July 1985: -The TSTA says it will go to comt to fight the test 

{Amcncan Statesman, 6/18/85, News-Globe, 7/24/85) 
-June-July 1985: -The Texas Federation of Teachers (TFT) says it 
supports the test and thinks a lawsuit would be 
"devastating to the image of teachers" (American 
Statesman, 6/30/85, News- Globe 7/24/85) 
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-July 1985: 
-August 1985: 

-August 1985: 



-Sept.-Oct. 1985: 



-January 1986: 



-January 1986: 
-February 1986: 



-March 5, 1986: 



-March 10, 1986: 
-March 11, 1986: 



-March 14, 1986: 



-The ATPE says it will not challenge the test in court 
{News- Globe, 7/24/85) 

-The TFT's John Coles tells reporters that the teacher 
test should be as difficult as a bar exam for lawyers 
{American Statesman, 8/71/85). 
-The TSTA files its legal challenge to the test and 
complains, ""We're fed up with the lack of support of 
other so-called professional organizations and unions 
who quit or sold out...'' (American Statesman, 8/30/85). 
-The Texas Classroom Teachers Association (TCTA) 
mobilizes to provide test preparation courses for 
teachers across the state {American Statesman, 
9/13/85, 10/6/85, News-Globe, 9/13/85, 10/13/85) 
-The TCTA complains about the published want-ad for 
TECAT test administrators: the qualifications were 
only that they be w^'.-dressed and have a car 
{NewS'Globe, 1/11/86). 

-The TFT pushes for a lower cut-ofF score on the TECAT 
{News-Globe, 1/13/86). 

-The ATPE goes to court to prevent school districts 
from firing teachers who will fail the TECAT on the 
first trial, before the teachers get a chance to take the 
make-up exam {American Statesman, 2/7/86). 
-A TSTA representative complains about the proposed 
procedure of sticking gimmied labels on teaching 
certificates to indicate that the TECAT was passed. 
The TFT calls it a ^good procedure'' (American 
Statesman, 3/5/86). 
-Teachers take the TECAT 

-Teachers, not identified with a teacher organization, 
tell reporters that the test was ^insultingly '^jy" 
(American Statesman, 3/11/86). 

-The ATPE complains about Mark White's statement on 
television, ""There will be subject matter testing at a 
later date. " The union says his statement constitutes 
""harassment of Texas teachers" (American Statesman, 
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-March 15, 1986: -The TSTA lodges an official protest with the Texas 
Education Agency about yy- atisfactory test-taking 
conditions {Amtrican Statesman, S/15/86). 

-May 1986: -The ATPE says of the high passing rates, ""We knew all 

along Texas teachers were competent'' (News- Globe, 5/9/S6) 

-May 1986: -The TSTA plans to file a suit alleging racial 

discrimination in the TECAT {News-Globe, 5/15/86). 

What kind of conclusion did readers draw from such coverage? Our impres- 
sion is that they would have foimd teacher groups imorganized and fractious. Some 
groups were fighting the test; other were supporting it. They called each other 
names and were always threatening litigation. They said the test was ridiculous, 
yet they went to great lengths to prepare for it. They were constantly complaining 
about insignificant issues like gimmied labels and test proctor qualification. They 
complained about indignities, but acted undignified. They complained that they 
were not being treated lik^ professionals, but as the story was told in the press, they 
did not appear to act like professionals. Although many of the facts had another 
side or a different interpretation that might have been further explained, the facts 
r^d events in thes^ stories were largely correct. Although many individual members . 
of >he public might have been persuaded by the teachers' point of view had they sat 
down to discuss their concerns in detail, there is no question but that the general 
public saw a very negative and imflattering picture of Texas teachers for a period 
of over three years. 
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Section 4: THE TECAT 



When basic skills testing of practicing teachers was first envisioned in Texas, 
it was commonly understood that many teachers had already taken nationally stan- 
d<u:dized examinations that would signify their competence. Discussions about test- 
ing for teacher competence did not necessarily imply that Texas would develop its 
own te:t, nor that every teacher and administrator would take it. These decisions 
came later. In the original recommendations of the Subcommittee on the Teaching 
Profession to the Select Committee, teachers would have been allowed to "otherwise 
demomtrate competency by means of an acceptable score on the Graduate Record 
Exam, National Teachers Exam, Miller Test of Analogies, General Management 
Aptitude' Test, Law School Aptitude Test, Medical School Aptitude Test, Scholas- 
tic Aptitude Test, American College Test or other accepted graduate school entrance 
examination. " These specific substitute tests were eliminated in the final recommen- 
dations of the Select Committee but the idea of submitting "an acceptable score on 
alternative tests approved by the Board" was carried forward. The language of H.B. 
72 was noL specific about the nature of the one time test but many still believed 
that other prior tests might cotmt. June Carp said that the TFT woiold lobby for 
using the National Teacher Examination or the Graduate Record Examination as 
evidence of competence. 

The State Bo-ird of Education was empowered to implement the teacher 
testing mandate. Mack Prescott, chairman of the Committee on Personnel for the 
State Board of Education and Commissioner Kirby convened a panel of testing ex- 
perts to .dvise them; the measurement and evaluation specialists were from various 
institutions in Texas with the exception of Dr. Gregory Anrig, President of the 
Educational Testing Service, and Dr. James Popham, UCLA Professor and author 
of the Arkansas teacher test. At a February 1, 1985, meeting, intended to determine 
the feasibility of "equating" various tests, the two external experts were instrumen- 
tal in convincing TEA that existing test scores could not be used. Anrig first gave 
a speech objectmg to the testing legislation, arguing that it was unfair to teachers 
who had passed a number of previous evaluative hurdles; it would put all teachers 
through a punitive exercise for the misbehavior of a few; and it would make a test 
the sole criterion for continued employment. He sn xifically withdrew the use of 
ETS tests, the PPST, the NTE, the SAT and the Gi.E, because they had not been 
validated for the use now being contemplated. 

Commissioner Kirby alerted me in advance that the question will be 

asked-Can certain other tests be used as you just described? That is, 
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to give the teacher the benefit of the doubt and not have them jump 
through hoops unnecessarily....! talked with President Hackford of the 
College Board and Dean Verstige of the Graduate Examination Board, 
in all three cases, their position is that the use of their tests, even 
from the past, in this manner Jut this purpose, would he in conflict 
with the guidelines for proper test use for their programs.. ..While we 
understand and applaud your trying to find some avenue of recourse 
here, that particular avenue is not available. 

Dr. Popham disagreed with Anrig's disapproval of the testing mandate. 
There are in fact all of the checks that you isolate. And yet despite all 
those checks, there are some teachers in our states, who cannot read 
and write at a level such that I feel it appropriate to let them loose 
on children. I am concerned about the children in the classes of those 
teachers and I believe it perfectly reasonable for a state legislature to 
adopt the stance that in order to protect those children, we will install 
an assessment procedure. 

However, Popham also argued against the use of prior tests to exempt some teachers 
saying that it would make the state liable for lawsuits even if new validity studies 
were carried out. 

Having done the content validity on the existing test, you still find 
yourself, I would argue, in a position of legal vulnerability. Remem- 
* the atmosphere. (Suppose) I am a teacher who has been denied a 
diploma because I have taken the state ordered test. I didn't happen to 
take the Graduate Record Examination or any of these other exams, 
so I take the state ordered test and I flop; I don't pass, I don't get 
my credentials; Fve taken it three times and I don't get my creden- 
tials. Am I not in a marvelous position to assail in the cour^^oom and 
say had I only had the opportunity that perhaps other more fortunate 
individuals had, to take these other tests, would I not now have my 
credential and have not my constitutional rights been violated? 
The Commissioner and TEA staff came away from the meeting of experts 
with a clear understzjiding that they would have to give a test to all teachers and 
administrators in Texas. The meeting also confirmed TEA expectations that devel- 
oping subject matter tests would be excessively costly (estimated at $17 million) 
and would be impossible within the mandated time period. It was anticipated that 
as many as 150 tests would be required tc match individual teaching assignments. 
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"An eighth grade math teacher could not be given the same test as a teacher of Cal- 
culus." Although TEA was in the process of developing more than 30 subject matter 
tests to be administered to teachers entering the profession, they were advised that 
these tests would not be defensible for practicing teachers unless they started from 
scratch with new validity studies. Quoted in the Statesman the day after the meet- 
ing with measurement specialists, Commissioner Kirby said that he expected that 
a basic skills test alone would weed out 80 or 90 percent of incompetent teachers. 

Two weeks later, the State Board adopted a recommendation to the legisla- 
ture that all teachers take a basic literacy test but that subject matter examinations 
be postponed. Again, the chairman of the Beard, Jon Brumley, explained that the 
basic skills test alone ^will catch 85-90 percent of the few teachers out there who are 
incompetent from a literacy sense. TEA staff and teacher lobbyists recalled that the 
proposal to delay subject matter testing won approval in the legislature because of 
the very high price tag and because, by the time of the 1985 regular session, some 
of the ardor for testing had waned. The majority of legislators were not willing to 
give up entirely on the idea of testing as evidenced by the defeat of S.B. 103. The 
State Board proposed and the legislature accepted a basic commimications test as 
a good faith implementation of the testing requirement; 6.5 million dollars were 
appropriated to develop this test as well as appraisal procedures in support of the 
new career ladder. 

The Texas Examination of Current Administrators and Teachers, the TEC AT, 
was developed to assess the minimum reading and writing skills "that practicing ed- 
ucators need to perform adequately in their jobs." The procedures used to determine 
what the test content would be and to review individual test items are described 
in a paper by Yalow (1986). Extensive efforts were made to ensure that the test 
"would be able to withstand intensive legal and technical scrutiny." (p. 1) First, a 
30-member Advisory Committee of teachers, administrators, university faculty, a 
other citizens generated a list of possible reading and writing skills to be measured 
by the TECAT. Then, these skills were rated for job relevance by a representative 
sample of 4,000 Texas educators.* Table 4.1, reproduced from State Board hand- 
outs shows the appropriateness ratings for TECAT skills from various respondent 
groups. 

The same sample also rated the potential bias of each proposed skill. The 
results, reported as the perctatage who said a skill area was not biasea, closely 

* Judging fiom handouts summarizing results for the State Board, the response 
rate for this survey was 50%. 
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Table 4.1 

MEANS (M) AND STANDARD DEVIATIONS (SD) OF APPROPRIATENESS RATINGS 

FOR TECAT SKILLS* 



Skill Total Hispanic Black Other 



(n-2,002) (n»263) (n«203) (n«l,526) 
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4.17 


.94 . 


4.06 


.95 


4.17 
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4.19 
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4.16 
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4.04 


1.07 
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1.12 
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4.41 
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4.25 


1.01 


4.45 
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Sen. Form. 


4.44 


.84 


4.38 
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4.37 


.99 


4.46 


.81 


Ehg. Usage 


4.54 


.79 


4.48 


.83 


4.44 


.89 


4.56 


.77 



♦Responses to the question "Is this skill needed for successful 
performance as an educator in Texas public schools?" {Response 
scale: 1 « Definitely No, 2 = Probably No, 3 = Maybe, 
4 « Probably Yes, 5 « Definitely Yes) 



paralleled the appropriateness ratings in Table 4.1. For example, 96.7/o of the 
respondent group said that the main idea reading skill was free from bias. Eighty- 
six percent said that the professional vocabulary skill was free from bias, with 
slightly less support from black respondents (83%). 

On the basis of the above data, the State Board adopted the content outline 
from which the TECAT would be developed. The reading test was to be comprised 
of 55 multiple-choice items. Ten items each would be used to measure recognition 
of details and comprehension of the main ideas from reading passages, job-related 
vocabulary, distinguishing fact and opinion, and reference usage. Only five items 
would be included to measure inference, the most controversial skill area. The 
writing test would include both a short composition (150 words) and a multiple 
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choice portion. If examinees unambiguously passed or failed on the composition, 
their multiple choice answers would not be considered. Examinees who <^arned in 
a marginal essay, however, would have to pass the 30-item multiple choice portion 
covering mechanics, sentence formation and English usage in order to pass the 
writing test. School personnel who failed the reading or writing part of the test in 
March of 1986 would have one chance in June to retake the portion they had failed. 
Additional opportunities to retake the test would be provided but not in time to 
save being uncertified for September of 1986. 

To illustrate the types of skills measured by the TECAT a sample "main 
idea" question is shown in Figure 4.1 along with the test specifications published in 
the TEA Study Guide. Similarly, the guidelines for punctuation items are shown 
in Figure 4.2. Lastly, to convey the scoring levels for the written composition, a 
marginal essay and a failing essay are reproduced as Figures 4.3 and 4.4 (Texas 
Education Agency, 1986a). 
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Figure 4.1 

A Sample Reading Skill from the TEA Study Guide 



MAIN IDEA 

TePt items for this skill will require examinees to select the best statement of the main idea of a reading 
selection. 

Sample Item 



Adapted from an education journal: 

One way to make learning meaningful, enjoy- 
able, and accessible to a greate. number of 
students is team teaching. Many approaches to 
team tearring have been used. Perhaps the 
most su'^^^ssful approach has been to* have 
teachers /rom different discipli^ds work 
together as a team. Units or entire courses 
could be team-taught, showing the relation- 
ships between, for example, art and geometry, 
mathematics and music, or foreign language 
and history. T^*:; e are many possible combina- 
tiOi.s. Such a program could provide support 
and enrichment for students and teachers alike, 
creating a fertile, stimulating learning envi- 
ronment. 



Which of the following is the best statement o' the 
main idea of this selection? 

A History and foreign language can be effective- 
ly taught together, 

B Students and teachers can benefit from team- 
taught courses that combine subjecta. 

C It is impossible to teach two different subjects 
in one ^ourse. even with two teachers in ti.e 
classroom. 

D Tearr teaching is being used incred^^ingly in 
public schools throughout the Unitea States. 
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Figure 4.1 Continued 



TMt Questions 



i^^a I^IJ o^! «n^l« ?K "^'".^ communicates a single, central idea that is explicitiv 

"Sh f T^'^"^ * ^«c^ selection wil! be followed by the question. 

Which of the following is the best statement of the main idea of this selection?" 



Answer Choices 



irH^r'* *r!rr T'""^ ^" statement of the selection's main idea. It ma, be paraphrased 

or clearly implied by the selection. j m m 



The incorrect answer choices will be one of the following types: 

— Inappropriate in scope: 

(1) Too narrow: A statement that does not account for all the important information in the reading 
selection. 

(2) Too broad: A statement that overgeneralizes beyond the information contained in the reading 
selection. 

— Inaccurate: A ststement that contradicts information in the reading selection. 

— Irrelevant A statement that introduces information not included In the reading selection. 
Explanation of Correct Answer to Sample Item 

Choice B: Every sentence in the item's reading selection relates to the concept of team teaching as a potentially 
useful teaching tool. The first sentence introduces the idea of the benefits of team teaching. The papsage then 
descnbes what may be the most successful approach to team teaching, that is, combining the efforts of 
teachers from different disciplines in a single course. The reading selection closes with a sentence that 
indicates that both teachers and students can profit from team teaching Therefore, choice B is the best 
statement of the main idea of the selection. 

Expliiiiatlon of Incorrect Answers to Sample 'item 

Choice A: This statement is inappropriate in scope because it is too narrow. Although the reading selection 
suggests that history and foreign language may be effectively combined, other combinations of courses are 
descnbed as well. Moreover, this answer choice does not mention team teaching, the selection s central topic 
Thus, this answer choice is merely a detail from the reading selection, not its main idea. 

Choice C: This inaccurate statement contradicts information in the reading selection. The reading selection 
argues that teaching two different subjects in one course is extre-nely worthwhile— just the opposite of what 
is stated in the answer choice. 

Choice D: This statement is irrelevant because the reading selection does not indicate whether there is an 
increase in the use of team teaching. Thus, this statement, although plausible, is not the selection's main 
Idea. 
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Figure 4.2 

A Sample Writing Skill from the TEA Study Guide 

PUNCTUATION 

Test Items for this skili will require exar^'^ees to determine whether there is an error in punctuation in a brief 
communication. 

Sample Item 



Adapted from a letter to parents: 

[1] Dear Parents: 

[2] Our first-grade students, are setting up a 
classroom supermarket to be used as a learn- 
ing center for various activities. [3] Would 
you be willing to help us? [4] Please "tend 
clean, empty containers from familiar super- 
market items. [5] Other props, such as play 
money or a toy cash regisit;r would also be 
appreciated. 

[6] Sincerely yours, 

[7] Mr. Johnson 
[81 Teacher 

[S] Costa Mesa Elementary School 



In which part of this communication, if any, is there 
^ • ^ . an error in punctuation? 

A Part [2] 
B Part [3] 
C Part [4] 
D None of the above 

Test Questions 

Punctuation items will consist of an excerpt from a written communication followed by the question. "In which 
p^.rt of this communication, if any, is there an error in punctuation.?** 

Each communication will contain either one error in punctuation or no errors in punctuation. P-jnctuation errors 
will be based on the punctuation rules that accompany the description of this skill. 

Answer Choices 

The first three answer choices will correspond to numbered parts of the written communic^ition that may 
contain an error. The fourth answer choice will be "None of i^e above." "None of the above" will refer to the 
parts specified in the first three answer choices. 

If the communication contains an error in the parts identified by the answer choices: 
— The correct answer choice will be: 

(1) the part of the conr.munication in which required punctuation is omitted or 

(2) the part of the con^munication in which an e.rtrdneous or misused punctuation mark is present. 
' — The incorrect answer choices will be one of the following types: 

^ (1) Proper Punctuation: A part of tne communication wnere no punctuation error is present. 

1 IERJ<C (2) Unidentified Error. The "None of tne above" answer cn'^ .3. 7 ^ 



Figure 4.2 Continued 



If the communication does not contain an error in the parts identified by the answer choices: 

— The correct answer choice will be "None of the above/' 

— The incorrect answer choices will be: 

Pro^«r Punctuation: A part of the communication where no punctuation error is present. 

Explanation of Correct Answer to Sample Item 

Choice A: There should not be a comma in part [2]. The subject and verb of a sentence should never be 
separated by a comma when they are next to. each other. 

Explanation of Incorrect Answers to Sample Item 

Choice B: Part [3] contains no error and demonstrates proper punctuation. The question mark is used correctly 
as the final punctuation for a sentence that is a direct question. (See punctuation rule 2.) 

Choice C: Part [4] contains no error and demonstrates proper punctuation. The comma between "clean" and 
"empty" is correct because adjectives in a list must be separated by commas. (See punctuation rule 3.c.) The 
period is the proper punctuation for the end of a statement. (See punctuation rule 1 .a.) 

Choice D: This answer choice represents an unidentified error because there is a punctuation error in part [2] 
of the communication. 

Punctuation Rules Eligible for '"'esting 

1. Periods are required: 

ar at the end of aH declarative sentences, including indirect questions 
b. after abbreviations 

2. Question marks are required at the end of a direct question 

3. Commas are required: 

a. in a series of three or more words or p'lrases (Educators will not be tested on the use of the comma 
before Vand" or "or" in a series) 

b. between two independent clauses joined by a coordinating conjunction 

c. to seprrate coordinate adjectives that modify the same noun 

d. to set off nonessential clauses and nonessential partiC'pial phrases 

e. to set off expressions, such as appositives, that interrupt the sentence 

f. after the salutation in a friendly letter 

g. after the complimentary close in a letter 

h. between the independent parts of a date (except when only one part of the date, such as the month, 
is used, in which case no punctuation is needed) 

i. between the independent parts of an address or geographic location 
j. before a direct quotation 

4. Semicolons &re required between independent clauses not joined by coordinating conjunctions 

5. Apostrophes are required: 

a. to form possessive nouns 

b. to form contractions 

6. Colons are required: 

a. to separate hours and minutes in time 61 

b. after the salutation in a business letter 
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Figure 4.3 

A Sample Marginal Essay from the TEA Passing Standards 



— 2. 

— 3. 
4. 

— 5. 

— 6. 

— 7. 

— 8. 

— • 9. 

— 10. 

— 11. 

— 12. 

— 13. 
14. 
15. 
16. 
17. 

— • 18. 

19. 
20. 
21. 
22. 







-slL 






ERIC 



62 

73 



Figure 4.4 

A Sample Failing Essay from the TEA Passing Standards 
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Roue f^^omrL 8UT Tftr: Ph^r F^J-xa^ ^ajPLJ^U^ 



Sr^tpgyT? /VTI l^Ds^A^r^A/T Hi k.^ ^rt-tnni TO TRY ft 



l-ITTL^ H^gr^ygg. /)v n> n>o th-^ T3gST T/^g y a^/i/, 



/^/S Mf'onK — r??/y-/U^rYr^ lA/m <^rt7-^ =^ That c^j^^/vjig. 
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The test content was agreed to in June of 1985. In the Fall, preliminary 
versions of the test were pilot tested. Items were also rated for content validity 
by the Advisory Committee and by another statewide survey of 1,000 teachers, 
administrators, college faculty, and school board members. Table 4.2 is an example 
of the type of su/nmary data presented to the State Board. Items were reviewed for 
bias by a special review committee set up to represent (1) organizations concerned 
with equitable treatment of minorities, (2) professional educator organizations, and 
(3) individuals knowledgeable about minority concerns in Texas (Yalow, 1986). An 
absence-of-bias index was reported which was the percentage of comn:iittee members 
endorsing an item as imbiased. A criterion of .95 was required to retain items in 
the tes^. Thus all itenis eventually used in the test were judged to be unbiased by 
95% of reviewers. 
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Table 4.2 



JUDGED CONTENT VALIDITY RATINGS OF TECAT READING AND 
WRITING SECTIONS BY ADVISORY COMMITTEE AND STATEWIDE 

SURVEY RESPONDENTS* 



Reading Writing 



Group 


■ 

Mean 


Standard 
Deviation 


Mean 


Standard 
Deviation 


Advisory Conunittee 


3.6 


1.0 


3.8 


1.0 


Statewide Survey 










Respondents 










Teacher 


3.5 


.87 


3.5 


.95 


Administrator 


3.7 


.84 


3.5 


.92 


School Board 


3.C 


.83 


3.6 


.78 


College/Univ. 


3.5 


.75 


3.7 


.92 


Total 


3.5 


.85 


3.5 


.92 



^Respondents were asked the following questions: 



Reading ; Assume that the reading section of the TECAT 
IS composed of "55 items (similar to those you just reviewed) 
containing 5 inference items and 10 items for each of 
the other five skills. On the five-point scale below, 
please indicate the degree to which you believe such a 
test would constitute a representative sample of important 
reading skills needed by Texas public school educators 
in their jobs. 

Writing ; Assume that the writing section of the TECAT is 
composed of two subsections. The multiple-choice 
subsection would consist of 30 multiple-choice it errs 
(simxxar to those you just reviewed) containing 10 
items for each of the three skills. The composition 
subsect ion would contain two composition ass ignments 
(similar to those you just reviewed) from which the 
examinee would select one. On the five-point scale 
below, please indicate the degree to which you believe 
such a test would constitute a representative sample 
of important writing skills needed by Texas public school 
educators in their jobs. 

Scale ; 1 * minimally rep resent at i ve , 2 « somewhat repre- 
sentative, 3 « moderately representative, 4 ^ very repre- 
sentative, 5 « extremely repres'^ntat i ve . 
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As a last step before the administratis of TECAT, the State Board wcis 
charged with setting passing scores on the two parts of the test. In January of 
1986, just two months before the test was to be admini-^.tered, TEA staff and the 
test developers assembled for the Board the various Tables summarizing the en- 
dorsements of TECAT skills and items. In addition, the Board was given data on 
reconmiended standards obtained from the Advisory Committee and several sur- 
vey groups. Table 4.3 is again an example of one of several tables provided to 
the Board. Data were also sunmiarized from the field testing, indicating what the 
expected failur rate would be for every possible passing score. Most importantly, 
Commissionei Kirby and his staff had already reviewed sJl of the above data and 
proposed to the Board that passing standards of 75% be adopted. Thus, examinees 
would have to get 41 out of 55 items correct on the reading test to pass and, should 
it be necessary to score an individual's multiple-choice writing test, the passing 
standard would be 23 out of 30 items. The Commiseioner's letter is provided iU 
Appendix G. The proposed standards were more stringent than had been endorsed 
on average by teachers and administrators but were close to what was suggested by 
school board members and college and tmiversity respondents. On the basis of field 
test data, the proposed standards would fail 12% of the teacher and administrator 
popul? ti I. However, the Conmiissioner estimated that fewer than half this niunber 
would actually fail since teachers could-be expected to study for the real test. The 
Board set the passing standards as proposed by the Commissioner. 
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Table 4.3 



PERFORMANCE STANDARDS RECOMMENDATIONS 
BY STATEWIDE SURVEY RESPONDENTS 
FOR THE READING SECTION* 



Before seeing field-test data 



Position 


Mean 


Standard 


Mean 


Standard 




Number («) 


Deviation 


Number (%) 


Deviation 


Teacher 


35.7 (64.9) 


8.1 


36.9 (67.I) 


7.8 


Administrator 


37.0 (67.3) 


5.7 


38.3 (69.6) 


5.6 


School Boar^ 


39.1 (71.1) 


7.6 


40.3 (73.3) 


5.7 


College/Univ. 


40.0 (72.7) 


6.2 


40.5 (73.6) 


4.8 


Total 


36.4 (66.2) 


7.8 


37.5 (68.2) 


7.5 



^Respondents were asked the following question: 

"Assume that the reading section of the TECAT is composed 
of 55, items similar to those you just reviewed, with 5 
inference items jind IG items from each of the. other five . 
skills. What is the minimum number of the 55 items that 
an educator in Texas public schools should Be required 
to answer correctly in order to pass the reading section 
oF the TECAT? '* They were then given a table showing the 
cumulative proportion of field-test examinees who would 
have achieved each score point on the reading section of 
the TECAT had these examinees been administered a repre- 
sentative 55-itero test* Respondents were asked the same 
question again af^er reviewing the table. 
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Section 5: MASSIVE REVIEW AND PREPARATION 



One of the most unexpected findings from our research was the monumental 
effort that went into preparing for the TEC AT. As soon as the test specifications 
were available, the Continuing Education Division of the University of Texas at 
Austin, In cooperation with the Texas Classroom Teachers Association, developed 
a review course and a 300 page self-study book. They trained 130 presenters who 
in turn instructed 89,000 teachers in one and two- day workshops. According to 
Dr. Shirley H. Crook, project director, "it was a major undertaking, lojistically." 
There were some weekends when 50 workshops were going on concurrently, with 
20-400 teachers in attendance at each. 

In addition, the University of Texas, in conjunction with the Austin Indepen- 
dent School District, developed 12 video tapes covering TECAT skills. These were 
distributed throughout the state. Most of the 20 regional service centers and many 
school districts purchased the University of Texas tapes and checked them out to 
teache-*s or used them as the basis for group review sessions. One superintendent 
kept the VCR iu his home set up for teachers ''night and day*' while his wife served 
popcorn. The videos were acquired by public access TV stations in major cities and 
shown repeatedly before both the first and second "^EC AT administrations. For ex- 
ample, on Channel 28 in Au ^in the tapes covering different skills were shown every 
half hour for 12 hours a day lor 30 days preceeding each testing date; in Corpus 
Christi the tapes were run in six hour blocks every day for a month. 

Teacher organizations developed materials and conducted workshops to en- 
sure the success of their members. (One union forbade the use of its materials 
by nonmembers; others were more generous.) Four major organizations in Texas 
participated. The largest, the Texas State Teachers Association, estimated that 
65,000 teachers attended thdr workshops. The Association of Texas Professional 
Educators trained ar. >ther 23,000. 

Nearly every school district in the state provided test preparation opportu- 
nities for their teachers. In some cases they used the Study Guide developed by the 
Texas Educa tion Agency and hired English teachers to conduct inservice sessions. 
Some districts made arrangements with loc?*l colleges and universities for revie^v 
classes. Many districts including large districts such as Houston, Corpus Christi, 
and San Antonio paid the workshop fees for their teachers to attend programs run 
by a union, a local college, or the University of Texas. The 20 regional service cen- 
ters likewise committed themselves heavily to preparing educators for the TECAT. 
Several developed their own materials and practice tests; some arranged traveling 
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workshops to reach remote areas. The staff at several regional centers worked in- 
dividually with teachers who failed the first time and needed practice to improve 
their writing skills. Many regional centers also hosted six hour v^deo programs de- 
livered by satellite through the Texas Interactive Instructional Network (TMN). In 
the course of our survey we found that most regional centers did a number of these 
activities; e.g., one center might hold workshops in four comers of the region and 
host a TMN session at the center office and check out tapes individually. For the 
second testing in June, a scaled down version of these same activities was provided. 
One director commented that there could not have been a single teacher in the state 
who wanted formal review but could not find it. 

Distributions of teacher time spent in preparing for TECAT are displayed 
in Table 5.1. In telephone interviews with a representative sample of teachers and 
administrators, respondents were asked to estimate how many hours they had spent 
attending formal review sessions or workshops. Then they were asked how many 
hours they spent studying on their own or watching TV review broadcasts? Only 
13% of educators reported that they did not prepare for the test. An additional 14% 
spent only one hour looking over the format of the test and reviewing terminology. 
On average, coimting both those who studied and those who did not, educators spent 
12 hours preparing using a combination of both formal review and self-study. The 
substanc? of their preparation will be discussed in the next section. The average 
amount of time spent in formal workshops was 4| hours. Typically workshops 
were day-long sessions, reported most frequently as 6 or 8 hour blocks; the 4| 
hour average reflects the inclusion of the approximately one-third of educators who 
did not participate in formal review. The data are also characterized by extreme 
heterogeneity. In contrast to the teachers who studied hardly at all, one-quarter of 
the sample spent 20 hours or more, with some teachers estimating that they had 
devoted 50-100 hours to test preparation. 
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Table 5.1 

Frequency Distributions of Teacher Time 
Spent Preparing for TECAT 

(n = 93, 3 missing ^tem data) 

Hours of Study; In Workshops Self Study Total 



0 


34 


20 


12 


1 


3 


15 


13 


2 


3 


8 


2 


3 


6 


6 


2 


4 


6 


10 


8 


5 


5 


4 


4 


6 


14 


5 


6 


7 


2 


2 


5 


8 


8 


2 


3 


9 


1 




3 


10 


2 


4 


7 


11 








12 


3 


2 


4 


13 






1 


14 






1 


15 


3 


2 


1 


16 


2 


1 


1 


17 




1 




18 






1 


19 








20 




3 


3 


21 






2 


22 






1 


23 








24 


1 




1 


25 








26 








27 




1 




28 






3 


29 








30 




3 


2 
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Table 5.1 Continued 

36 3 

42 1 

45 1 

50 1 1 

54 1 

56 1 

68 1 

73 1 

84 1 

100 1 

X = 4.34 X = 7.74 X = 12.09 
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Section 6: BASIC SKILLS AND "TEACHING TO THE TEST" 



On the day the first TECAT results were announced, and an impressive 
96.7% of the teachers passed, the test author. Dr. James Popham of lOX Assessment 
Associates, congratulated Shirley Crook for the incredible impact of the University 
of Texas' instructional progiam. Sharing in the euphoric mood that followed the 
announr ment, the Commissioner of Education expressed his delight, "The best 
lews of 2^' is that the TECAT scores are in and teachers did fantastic. Their 
perfonnanr<5 on thit. basic skills test actually surpassed our expectations." Indeed, 
teachers Lad done ^r^.ter than would have been predicted from the field test data, 
\^aere as vm^ny as 12% would have failed. Staff at ihe Texas Education Agency 
believed that all ;he training had had an impact, accounting for the very high 
passing rate on the real test. Many educators and politicians whom we interviewed 
about '^-i TECAT believed that it forced teachers lo learn basic skills essential for 
proper functioning In the classroom. 

Having studied TECAT workshops at first hand, we were not entirely con- 
vinced that rU of the gains on the test reflected real increases in teachers' skills. We 
had observea teachers and administrators practicing pimctuation and capitalization 
rules. But we also saw that considerable ticLe was devoted to test-taking stra ^ 
gies, even sometimes to techniques that would help get the right answer without 
mastering the skill being measured. 

An analysis was conducted of transcripts from our recordings of preparation 
sessions. To convey the sense of that analysis, several examples are offered from 
what we called content teaching, as distinct from teachir ^ test strategies. The 
following are quotations from instructors where a rule or explanation is being given. 

Use semicolons as a conjunction. Look at the first sentence: ^^He 
loves faculty me^iings; I hat^^ them/' You coula just as easily say 
thai as ^0 simple sentences. When you have a sentence fragment 
you almost want to go, ^yes, what's next?'' You anf^ripate there's 
something else. If there's nothing else and you keep thtnki, % ^'what's 
going on here?'' It's not a complete thought. There art key wou Is: 
''because," ''although/' ''when," "therefore," "however." 

The next thing that we want to consider is development This *? wha: 
zeros in the context of the middle of your writing sample, whether 
it's a letter, whether it's a report, whether it's a mevn.orandum, the 
pattern remains the same.... We develop an idea when we downshift in 
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generality. This is something that we mentioned in our je.mon. 
To downshift we simply become more specific in what we're talking 
about. So if we made a general statement, ''education should be a 
primary goal of a healthy community , now we drop down a leid and 
give somt reasons why this is true. 

We classified almost all practice time, whether on sample sentences or test 
items, as content teaching. Exceptions occurred only when a test strategy was being 
emphasized rather than a substantive rule 

In our analysis we further distmguished between legitimate and questionable 
instances of "teaching to the test." According to the psychometric and measure- 
ment literature, test-taking strategies are considered legitimate if they helped an 
examinee "show what he knows." The Test S^^andards of ohe American Psycholog- 
ical Association, in fact, urge that test takers be informed of any strategies that 
are "unrelated to the construct" but that "influence test performance" ( APA, 1985, 
p.27). Many of the topics covered in the University of Texas course and materials 
fall into this category, e.g , famiharization with test format, scoring rules, advice 
about guessing strategies, and anxiety reduction techniques. Examples of this type 
of teaching to the test are given by these excerpts from workshop presentations. 

In all of your testing on the TECAT, iVs best that you look at the 

question first, so that you know what you're looking for. 

If you reach a question that you're unfamiliar with.... all you do is 
frustrate yourself if you continue to pore over that question. So, my 
suggestion to you is, go th'^ough, read the questions. And then if an 
answer is just not readily apparent and you've given it the amount of 
consideration it de.serves, skip iL.... 

You don't want to leave any empty spaces. There are no penalties for 
guessing on this test. 

The T'^jCAT will cover amy two uses of the semicolon, both of which 
involve compound sentences. 

While this type of preparation should not be considered unfair or inappropriate, it 
worJd be hard to argue that the substantial amount of time spent in these activities 
was really teaching teachers essential basic skills. 

When asked to say what they had learned from studying, the great m jor- 
ity of teachers interviewed in the probabihty sample indicated that workshops and 
study guides had helped by making old knowledge fresh and by familiarizing them 
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with test format rather than by teaching them skiuiJ. Many educators gave answers 
about studying that were puzzling initirilly. Upon examination, their responses re- 
vealed that teachers did not /'■.gard their test preparation time as study. In answer 
to the direct question, "Did you study for TEC AT?" only 66% of educators said yes. 
Yet, in Table 6.1, we have reported that 87% said they spent time "studying." When 
teachers answered "no" to the study question, we probed, "not even a review sheet 
or study gu^de?" Wheieupon, many respondents would say, "Well, I attended a re- 
view session but I would not say I studied." Some of these same respondents went 
on to say that they had spent up to 15 hours preparing for the test. Repeatedly, 
elaborated answers indicated that to them studying r at learning subject mat- 
ter material which they clearly distinguished from th ^ test-preparation activities. 
Accordingly, the teacher time data in Section 5 were labeled as test-preparation 
efforts. 

Table 6.1 provides a summary of what educators said they learned from 
workshops and self study. Percentages were calculated based on the leading an- 
swer given by each respondent. Many cited multiple benefits from formal review, 
corresponding to the three highest frequency categories. For example: 

It just renewed my confidence and some things I had forgotten in the 
past. And, certain things popped up that helped me on the TECAT. 

It helpedy fust memorizing the definitions and terms and practicing 
how to eliminate the wrong answers and practicing the essays .with 
200 words or less. 

It helped, definitely, psychologically because it answered questions as 
far as what was going to be asked. It relieved anxiety, but as far as 
learning anything.... I rvissed maybe two during the review session so 
it just pointed out things I needed to be careful of 

Only three teachers said • hey had learned rules which they had no^ known previ- 
ously. For example: 

/ graduated from college over 30 years ago. I had not had a test or 
anything like that since 1954 I just returned to teaching. That's 
why I had to study so hard. So many rules had changed. They don't 
punctuate like they did when I went to school. 
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Table 6.1 

Interview Questions about the Substance of Test Preparation 

(n = 93, 3 missing item data) 



Did ycu study* for the TEC AT? 

Ye3 87% 
No 13% 

*Note: The authors used "studying" to mean all test-preparation 
activities; but many respondents said they prepared but did not 
study; percentages reflect the more inclusive use of the term. 

Did studying help or was it a waste of time? 

(D: \ not study) 13% 

It helped 77% 

It was a waste of time, or did not make a difference 10% 

What do you think you learned, or what skills did you improve, as 
result of studying? 

(Did not study, or derived no benefit from prep? -ation) 20% 
Became acquainted with test format , 34% 
/ Studied format not subject matter, what the test was 
going to ask and the types of questions that would be asked. 

I thought it was quite worth while, because it made you 
aware of the tncks that were used. 

It helped me to prepare for the kinds of questions that 
would be asked. 

The format they presented at the workshop vias exactly what 
we had on the formal test. 

She would present a sample of what was going to be on the TEC AT 
avd she would explain how you had to eliminate incorrect 
answers and thus come up with the correct answer. 

Brushed up skills and reviewed terminology 33% 

Since I teach math, it helped to bring hack English rules, 
punctuation, capitalization, spelling and t : of thing. 

It was just kind of a brief review. 
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Table 6.1 Continued 

I wouldnH say I improvea any skills. I just went over 
terminology. Some of the terms are more familiar to 
administrators than to classroom teachers. 

It helped by reviewin^ jrammar rules. 

I think it refreshed my memory in some things, yes. 
Oh, ^lie^ and ^lay. ^ I don't feel I improved anything. 

The night before I went over the professional terms. 

It reviewed a lot of rules for me and I needed to he refreshed 
on that 

It probably refreshed my mind on grammatical rules. 

Increased confidence and relieved anxiety 

It helped me. I feel sure I could have passed the test without 
studying but it decreased my anxiet 

(Studying) made me more self confident taking *he test 
In that respect I think it helped me more than anything. 

I think it built' confidence, in getting back to doing some 
individual writing and thinking about thai. As much as I hated 
the thing, I still felt like it made me more aware and more 
careful about writing and responses to the questions. 

Learned new skills 

/ had a little trouble with my punctuation and my 
capitalization because I speak many languages. I speak six 
languages and each has their own ru^cs and I did get mixed 
up before. Now Fve straightened that out. 

I think I learned some thing,%, like token you need who and 

when you need whom, things like that that you don't redly pick up. 
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At some point legitimate teaching to the test crossed over an ill-defined line 
and became inappropriate. For example, after explaining that the writing samples 
would aach be graded in one or two minutes, one workshop instructor explained 
that "it's better to paragraph in the wrong place than not to paragraph at all" 
(bee use at least it would look right to the grader). 

The examples of teaching to the test of questionable legitimacy were instances 
where the strategies went beyond helping the examinee "show what he knows." 
Insteztd the strategies had the effect of helping the examinee ''hide his ignorance" 
or using the multiple-choice format to "pretend to know." Although these strategies 
are not illegal (since they are permitted by the test), their use clearly distorts w!:at 
the test can cl2um to have measured. 

Over and over again, the most widespread ex2unple of this second type of 
teaching to the test involved exploitation of the test specifications, published by the 
Texas Education Agency, to "psych out" the multiple-choice test questions. The 
TEA study Guide explair . how the wrong alternatives would be constructed for 
every type of question. For example, for inference questions on the reading test 
incorrect ^wers would be of the following types: 

Tnaccurate; A statement that is contradicted by information in the 
reading section: 

Unsupported; A statement that may sound reasonable^ but does not 
necessarily follow from information in the reading section. 

Irrelevant; A ^statement that is in no way logically true based on 
information in the reading selection. This inference often introduces 
information not included in the section. 

In some sessions we attended, teachers were encouraged to rule out "irrele\ant" and 
"specifically stated" answers so as to arrive at a correct choice among alternatives 
by a process of ehmination. We came away thinking that teach<^rs who were really 
struggling with inference would now be able to pass the items hut would be unabx^ 
still to recognize two valid mferences from the passage. 

Similar strategies for ruling out "way out" wrong answers were encouraged 
for main idea, detail, fact and opinion, and even vocabulary items. The University 
r>f Texas tapes included the following information from the test author: 

...something oery special will occur in the answer options for thz 
FACTS and OPINIONS questions. Review course workshop personnel 
at the University of Texas at Avstin has confirmed that this pattern 
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will appear on the test. So, youV want to listen carefully to the fol- 
lowing information because it virtually insures success on this TEC AT 
section. Of the four answer options, two will be fact and two will be 
opinion always. Of the two fact statements, one will appear in the 
passage and one will not appear in the passage. Of the two opinion 
statements, one will appear in the passage and one will not appear in 
the passage. This information has some very important implications 
for us, LeVs consider these implications. First of all, if you are asked 
to identify a fact, the first thing you cm do s simply ignore th^t two 
opinion statements. With the two remaining facts you merely have 
to determim which one of those two happen to appea'^ in the passage. 
The same would work for the opinion statement.... 

Of course the examinee still lias to do the basic sorting, still has to recognize fact 
and opinion. But if a teacher were having trouble making the necessary distinction, 
wouldn't it make it easier to know that there are always two A each? 

The extent of teaching to the test vatied greatly from one workshop to the 
next. In our sample, the video-taped presentation had the greatest proportion 
content teaching; in the worst case, teaching of content represented less than half of 
the workshop day. While content received emphasis in most of the workshops mosc 
of -the time, the widespread avaikibilivyof "test-taking- tricks^' has to be considered 
as a partial explanation for the extreriely high passing rates. 
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Section 7: TECAT PASSING RATES 



The data from the first administration of the TECAT are presented in Table 
7.\. The passing rate was 96.7% statewide but with a disproportionately higher 
failure rate among minorities, especially black teachers and administrators. There 
was also a pronounced age trend in the data indicating that older teachers were 
much more likely to fail the test than were younger teachers. 

Data reported by institutions gianting college degrees showed considerable 
variability. For example, graduates from the University of Texas at Austin, at San 
Antonio, and at Arlington passed the TECAT at rates exceeding 99%. Whereas, 
there were numerous colleges in Texas (mostly small private institutions) where 
the passing rate was as low as 55%. Out-of-state candidates had a 97.9% passing 
rate. Early in our study, one imion spokesman suggested that it was this extreme 
variability in the quality of gra^^ ates from different institutions that had been the 
real impetus for the T^jCAT. If some schools do not have entrance requirements 
and do not assure some level of academic accomplishment before graduation, then 
teachers from these institutions will not have the basic skills implied by a college 
degree. It was in response to this concern that Texas had already established 
both the Preprofessional Skills Test (PPST) and the exit (EXCET) test for teacher 
trainir p'-ograms. Interestingly, the institutional data from the first aidministration 
of the _.XET correlate very highly with the institutional pattern in the TECAT 
data. - 

The s !Cond administration of the TECAT raised the nnal passing rate to 
99%. Of the 6,579 teachers who failed the test in March, 4,704 retook an equivalent 
version of the test in June ' passed; only 1,199 teachers failed a second time; 
676 teachers did not sign ut be retested. One must ai^o consider an additional 
group of about 4000 teachers who originally registered for the TECAT but never 
took it. Reasons for not taking the test include illness, retirement, leaving Texas, 
and leaving the profession. We heard vague talk about tesichers who decided to 
retire early rather than face the pressure of the test. Personnel directors had heard 
these stories as well. About half of the directors said they k.xew personally of a few 
teachers who said that the 1 ZCAT was a major fawrtor in theii decision to retire. 

Ixi an effort to understand what kinds of teachers had been "weeded out" by 
the test we examined district level data. We also relied heavih' on tne acco'* ^ts of 
personnel directors and a represercative sample of teachers. On the positive side 
(i.e., the test was good for Texas education) we can offer these points: 1) nearly 
all teachers indicated that the TECAT was a fcar test of literacy skills essential for 
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Tabl- 7.1 

Performance on the TEC.4T: March 1086 Administration 



By ethnic group: 

Hispanics Blacks White/Other Total 

Number tested 24,685 15,681 156,505 202,084 

Number passing 23,195 12,802 154,838 195,505 

(Percent) (94.0%) (81.6%) (98.9%) (96.7%) 

Note: Individuals who did not report their ethnic group are counted 
in the total but are not included in the separate categories. 

By age group: 



Age 


Number Tested 


Percent Passing 


0-29 


38,971 


97.8% 


30-39 


74,706 


97.6% 


40-49 


52,349 


97.2% 


50-59 


29,985 


94.0% 


• 60-65 


4,615 


90.5% 


Over 65 


721 


87.7% 


Not Given 


384 


87.2% 



good communication in the classroom, 2) teachers "admitted" that the one or two 
failures they knew personally used poor grammar in their day-to-day conversation, 
3) personnel directors classified the teachers, who had been fired by fsuling t • 
as "average" teacher>; they were neither exemplary nor very bad, 4) rarely, we did 
bear a story about a woefrlly incompetent teacher who should hive been fired years 
ago; "the test finally got him." 

The negative side involves those instances where a teacher was fired beca ise 
of the test who should not have been. We examined data for districts where the 
passing rate was 85% oi less on the first testing. All of these districts wi^h high fail- 
ure rates fell into one of thrc^ categories: districts comprised of group homes for the 
mentally retarded or emotionally disturbed, heavily impacted mmority districts (3 
districts), or small rural districts with fewer than 30 teachers all together. Teachers 
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of mentally retarded children were also identified by several personnel directors as 
the type of teacher they had lost because of TEC AT. 

As a group, vocational education teachers had a disproportionately high fail- 
ure rate. Several personnel directors noted that the loss of these individuals seemed 
particularly unfair since they had never been requi'^'^d to be college graduates to be 
certified. Often teachers who were interviewed expressed regret over a shop teacher 
who had been fired, "I know he doesn't speak proper English but he really knows 
machinery; and he's so good with the kids." Similar ambivalence regarding the le- 
gitimacy of the test versus the value of a colleague was expressed about many P.E. 
teachers and coaches, about bilingual education teachers, and a few kindergarten 
teachers. 

Table 7.2 provides a simmiary of teacher interview data about the character- 
istics of colleagues who failed TEC AT. The majority of teachers interviewed in the 
representative sample a. I not know anyone who had not passed. Many specifically 
stated that their <f ..t.ict had essentially a 100% pass rate. Others did not know 
who might have failed because of local adherence to imion guidelines for solidarity, 
whereby results vere not discussed and were aot repo.'i;ed to district administra- 
tors imtil after the second testing to protect the identity of those who iid not pass 
until the second try. Of those who knew enough to describe the teaching abilities 
of someone who failed, the great majority pressed regret that a good colleague 
might be fired. Only 4% of the responses could be categorized as "bad teacher" 
descriptions where the test might help to fire someone whose inadequacies were 
recognized. 

Additional data about the job assignments of teachers who were eliminated 
by the test are treated with the cost analysis in Section 9. 

Tne poignant stori* . about valued teachers lotrt because of the test were 
especially troublesome given what we know about test vinreliability. The TECAT 
was a v/ell developed test with presumably adequate reliability; nevertheless all 
tests have measurement error. Using both retest data and .standard setting data to 
approximate the number of marginally proficient examinees, we can estimate that 
from 4000 to 5000 of the teachers who passed have literacy skills no different from 
the ones who failed. 
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Table 7.2 

Teacher Interviews about Colleagues Who Failed 
Do you know any teaciiers who did not pass TECAT? 



Yes 



45% 
55% 



No (Everyone around here passed; we followed union 
guidelines to keep failures anonymous; I've heard 
rumors but I don't .know them personally) 



Can you tell me in a general way what kinds of teachers failed the test? 
Did their difficulty with reading or writing skills ever show up in their 
teaching duties? 

Do they have outstanding strengths m other areas that compensate for 
limited reading and writing skills? 

**Good teacher*^ responses 51% 

His speech is very country, you know the way football coaches sometimes 
talk, very west Texas type. I don't think he had limited reading. 
Wriiing was his biggest problem, ',i,ot getting it all down on paper 
properly. He's very bright in other ways and he's a very good football 
coach. He is an ezcelient role model. He expects his kids to be 
■ good and tow tKe line. He didn't do a lot^of writing as a P. E. ' teacher. 

He was hired for his auto mechanics skills and did not have a college 
degree. Probably teaching a mechanical course like that, grammar 
skilb weren't really stressed. 

She's the only black teacher on this campus. She's done a beautiful job. 
She didn't pass the essay part, but as a P.E. teacher she's not going 
to write or grade an essay. She got a ^B' in our graduate course 
and she's an important role model for the few black kids in our district. 

He was a biology teacher and a very good one, I understand. More 

recently he was a football coach. He's been teaching close to 35 years. 

He has sort of an innate ability to encourage young people to do their best. 

He didn't pass the writing test. He's done a tremendous job with the 
band. The response he gets from the kids was great. 

This person probably didn't have a very good background in language 
arts in school and p.obably hadn't had to write and remember correct 
usage for a long time. He's a physical education teacher. I've always 
heard that he does an excellent job with the kids. 
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Table 7.2 Continued 



This particular individual was a P.E. teacher and he was blact 
He's a real disciplinarian and had the respect of every child in the 
school. The school was largely black and Hispanic, so a lot of the 
children didnH relate to the white women teachers. But once they gr • 
in his class it was a whole ^nother' ballgame. If he fails again, 
it will be a real loss. 

The one tuat I know had had a great deal of difficulty with English 
skills in college and had had tutoring, not so much because of 
intellect but because of background and having heard incorrect 
English usage all their lives. I believe this person was a very 
good teacher in other respects. 

"Bad teacher'^ responses 4% 

If the administrators had been doing their job, they would have 
gotten rid of this guy a long time ago. Just talking to him, being 
around him, it's obvious this man doesnH know which end is up. 
He doesnH spend much time on his own preparation. 

W^ll, it was the obviotts onc4. The ones-thai their grammar was 
incorrect and their written communication was not acceptable, which 
was already known among their peers and colleagues. They had never 
done anything about their teaching. Probably their strengths were 
patience and their ability to work with children. They were 
eleraeniary teachers, two black elementary t;achers. They had been 
teaching for many years and their incompetency had already been 
known but nothing had ever been done about it 
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Section 8: TEACHER MORALE AND PUBLIC CONFIDENCE 



Before our first visit to Texas, we had read newspaper accounts of teacher 
protests and about how insulted teachers felt at having to tetke a literacy test. Early 
on, leaders of teachers' organizations told us extensive stories about the anxiety 
and disruption the test had caused. But we had also been told by TEA staff and 
legislative aides that these stories were mostly union "hype." Legislators v/ho had 
sponsored the reform legislation believed that militant union leaders did not speak 
for the majority of teachers. They knew teachers personally back home who were 
quite willing to take the test if it would get rid of the few incompetents who were 
giving the profession a bad name. 

Interviews with scientific samples of teachers and personnel directors were 
intended to give a more representative picture. But even without the filter of pol- 
itics or media sensationalism, we were told consistently that the test had created 
tremendous stress and bitterness. Most compellingly, the 20-25% of teachers who 
did not themselves feel threatened by the test laonetheless described its negative im- 
pact on the majority of their colleagues. Simultaneously, the majority of personnel 
directors said that the TECAT had had no real effect in their district because vir- 
tually everyone passed; but it had generated negative attitudes and made teachers 
feel degraded. "We had a very bad year." 

Teacher interviews resulted in more than 1000 pages of transcripts; more 
than 100 pages were in response to these questions: 

Did preparing for the TECAT make you a better teacher? Did prepar- 
ing for the TECAT have any negative effects on your teaching duting 
the past year? (And later in the interview:) Whet has been the effect 
of the testing program on teachers? 

Only 5% of educators said ^.hat preparing for the TECAT had made them better 
teachers or administrators. Half said that studying or worrying about the TECAT 
had hurt their teaching either because of the time it took, because of the stress 
they were under, or because they were less willing to give time to extracurricular 
activities. 

The following verbatim quotations typify the reported effect of the testing 
program. 

/ think mostly what I found negative was the way I ^aw some of my 
peers and also some of my superiors, those who I Koktd up to and re- 
sped, older people, become concerned and a little bit worried about the 



84 



thought of having to take a test to enable you to secure your position. 

Well, now that it's over, I think everybody thought it was pretty simple. 
But in advance it sort of created some ill will. 

...some of my fellow teachers just went into orbit about the test, they 
were so anxious about it. I think for no reason, in some cases. Then 
it had a negative effect on their teaching and as a result I watched 
their frustration build and I began to wonder what the test was about. 

The morale really dropped. I have never heard so many teachers say, 
^If I could find another job. ^ ^It's about time for me to reHre.'^ Things 
like th It's really hurt. 

To me it was just a very negative feeling that the teachers got, through- 
out the whole test, of their profession. And I feel that a lot of us are in 
there becav^e it's something that we're wanting to do and we're stick- 
ing with it because we believe in it. But they did give us that negative 
attitude about the whole teaching pre y^^sion. 

I don't know how else to say it except it was just a humiliating expe- 
rience. One of the worst experiences I may have ever been through as 
a teacher....! begrudge the time that I had to take to study for it, to 
worry about it. 

We usually get really enthusiastic about different units that we're 
teaching, things we're going to study and things like that, and we 
just couldn't get ourselves up for it We felt, you know, that people 
thought we were incompetent and the kids, even in first grade, they 
would comment. 

Everybody felt like (we) were incompetent -from the kids to the gov- 
ernor. It was deflating to us. And everybody just felt really, really 
down. I think the governor's idea was that he was going to prove us 
competent and so teachers would go for him. Well, it backfired on 
him. 

I think it has given kind of a bitter attitude. And, I think it's been kind 
of just an zmbarrassment. You know, they've had sample question^* 
on the t.v. and they're so simplistic that it's almost a joke. 
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Low morale. It just really socked them in the stomach. Many peopL 
were very nervous, uptight, concerned about it. Especially the ones 
who had taught for over 20 years. ''What will happen if all of a sudden 
I'm found uncuited, unfit, without credibility?...'' 

The above responses represent over 90% of the teachers interviewed. Others 
said there was no effect on teachers or gave a positive reply such as the following: 

/ think that there definitely were some people, I include myself, who 
were pressed to learn a little bit more about the language; and ihaVs 
a good thing. There were a lot of bad things, especially for those 
who probably knew just about everything they had to know about the 
language. I'm pretty sure that everybody went through a very stressful 
time. 

^ To gedn some perspective on the negative feelings expressed, we should note 
that nearly 70% of teachers szdd that the reading and writing skills measured by 
the TEC AT were prerequisite to being a good teacher. "If you can't do these things 
you shouldn't be in the classroom." Thus, there woS^.^ large discrepancy between 
feelings about the principle imderlying the test, that all teachers should be litera' ^, 
and the test itself. To be asked to take a reading and writing test when they already 
held college degrees made testchers fpel less like professioijals, not more professional. 
To make matters worse, students and letters to the editor persisted in calling the 
TECAT a competency test when even the governor admitted it was only a literacy 
test. The editorial cartoon in Figure 8.1, for exeonple, Izonpoons teacher complaints 
and implicitly equates the literacy test with Medical Board examinations. Humil- 
iation and embarrassment occurred because media publicity invariably portrayed 
teacher protests alongside examples that made the test seem laughably easy. High 
anxiety was created because so much was at stake; many, many teachers said tha^ 
feelings would have been different if failing the test meant taking a college refresher 
course rather than losing your job. The pervasiveness of these themes in the two 
representative samples led us to conclude that TECAT consumed the attention of 
educators in Texas for the 1985-1986 school year and that it had a devastating effect 
on teacher morale. 

Perhaps the most negative effect of the TECAT has been the potential harm 
done to public opinion. Many teachers felt that the test and accompanying publicity 
actually worsened public confidence in education. In fact, teachers were about 
equally divided on this issue. Approximately half of the teachers interviewed said 
that the tect had done what legislators had intended, i.e., it had gotten rid of the bad 
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Figure 8.1 

March 1986 Editorial Cartoon Lampooning Teacher Complaints 




Thanks to Ben Sargent, The Austin America', ^taiesman, Universal Press 
Syndicate. 
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teachers and proven tt.at the majority are competent. The other 50% of teachers 
felt that all teachers had been made to seem less competent and that the 99% pass 
rate made the whole thing a joke. 

The foUowing sets of quotations were selected to characterize the two con- 
flicting positions: 

Teacher Position One: The TECAT proved to the public that teachers 
are competent; 

Now thaVs where I think something good has happened. I think the 
public realized maybe a little bit more how hard teachers work and 
really that they're bright people. 

I hope that it would show the public that we, the majority of teachers 
in Texas, are not illiterate. 

Well, it may have been a star in our crowv. Teachers probably take 
the brunt of society's ills. And the fact that 98% did pass may have 
impressed some people who are always complaining that their kid's 
teacher's probably the stupidest person on the face of the earth. 

I think that the public was surprised tf find so many teachers could 
pass the test. Perhaps they think a little higher of teachers. 

In the school district thai I'm teaching in, most of the parents and the 
public had confidence in us to begin with. 

I think it's important that we let the public know that we are good 
teachers and that we are teaching them something. If the children are 
dropping out or they're not learning anything, it's not our fault, it's 
their fault. 

It may have gotten the public off the school district's back a little bit. 

Teacher Position Two: Tlie TECAT was a joke. Now the public has a 
lower opinion of teachers than before: 

It was ridiculous. They think this was all a farce. 

I think they were hopeful that this was going to weed out incompetents. 
Every student, including myself, has had a bad teacher. And I think 
they were hoping in one broad sweep they could eliminate those who 
were not as professional as they should be. And I think they were 
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disillusioned because of the publicity afterwards - the way the press 
chose to characterize the type of test it was and how easy the test 
was. 

I think it's negative. The teachers were behind the S-ball. If they 
didnH do well on the test, then obviously they weren't good teachers. 
And if they did well on the test then the legislature-the first thing they 
said was, ^Whoa! This test was too easy; we passed too many. " And, 
therefore, you were dead if you did and dead if you didn't. 

The public does not like the classroom teacher. People feel that we 
were mealy-mouthed, that it was wrong for us to be angry over a test. 
They feel we always whine, wanting more money. 

Some of the jokes circulating now consisted of several pages of ridicu- 
lous, very ridiculous tilings. Say, for instance, ^find your way through 
a maze and the way is outlined very dark. ^ It was trying to emphasize 
how dumb the questions were, but I don't think they were that dumb. 
...You know, it was funny for a joke but it's not funny for teachers, 
it really demeans the teachers. 

I don'i think it's had any effect whatsoever on the general public. I 
mean, half of them are saying^ ^Gee, that was ridiculous. It was a 
waste of money. I knew they'd do good." The other half is saying, 
^Gee, that was a waste of money, t e test was too easy so I knew 
they'd all pass." 

Representative Data on Public Opinion 

Trying to assess what "the public" really thinks is diflScult. Even with rep- 
resentative survey data, results are sometimes internally inconsistent in that the 
majority of respondents strongly endorse both their schools and reform measures. 
In 1986 for example, 54% of Texans gave their schools a grade of A or B, a much 
higher percentage than occurred in the Gallup poll nationally. However, in the same 
survey 79% said they were in favor of competency testing for teachers (The Texas 
Poll, 1986), seeming to imply a need for improvement and quality control. The 
following data, in response to The Texas Poll's most global education question, in- 
dicates very little perturbation in public opinion across time, although some might 
see a slight positive trend associated with educational reforms. The 1983 data were 
collected before the enactment of reforms, while the Select Committee deliberations 
were in the news. The 1985 data were collected just after the passage of the reform 

89 



ERIC 



ICO 



bill but before implementation of most of the provisions. The 1986 siirvey was made 
after many of the reforms had been implemented but still before the administration 
of TECAT. The 1987 data were collected a year and a half after TEC AT, so that 
failed teachers had been out of the system for the entire pieceeding school year. 

Q. Students are often given the grades A,B,r D, and FAIL to 
denote the quality of their work. Suppose the public schools 
themselves, in your community, were graded in the same 
way. What grade would you give the public schools there - 
A,B,C,D, or FAIL? 





1983 


1985 


1986 


1987 


A 


12% 


15% 


18% 


20% 


B 


37% 


36% 


36% 


34% 


C 


29% 


9A% 


24% 


25% 


D 


8% 


6% 


8% 


6% 


FaU 


3% 


5% 


4% 


4% 


Don't Know 


11% 


14% 


10% 


11% 



Prompted by the teacher concern that TECAT may actually have worsened 
public respect for education, an effort was made to obtain relevant data on public 
opinion. We contracted with the Public Policy Resources Laboratory, Texas A & 
M University, which conducts the Texas Poll, to add questions about specific ed- 
ucational reforms to their stunmer 1987 survey. The poll was based on 20-minute 
telephone interviews with a representative sample of 1,000 adults from randomly 
selected telephone households. Sampling methods and administrative procedures 
are described in Appendix H. The questions were drafted by the authors in cooper- 
ation with the Director, Dr. James Dyer, to parallel as much as possible questions 
that had been asked in 1986 about educational reform measures (The Texas Poll, 
3(1), 1986). In Table 8.1 the results of the 1986 and 1987 interviews are presented 
side by side. The 1986 data were collected in late 1985, four to five months before 
TECAT was given for the first time. Approximately 18 months elapsed between 
the two polls. By the time of the 1987 survey, TECAT hsul been out of the news for 
a year and the 1986-87 school year had been completed with twice failed teachers 
removed or reinstated after a third try in October 1986. 

By the stxmmer of 1987, the public seemed less enamored with each of the ed- 
ucational reform measures. However, the endorsement for some reforms haxi fiJlen 
off only slightly while others had lost ground substantially. For example, the "no 
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Table 8.1 

"Before and After^ Texas Opinions on Educational Reform Measures 



1986 

Q. I am going to list some 
specific changes that were made 
and I would like you to tell me 
whether you generally favor or 
oppose the change. 

Do you agree with... 



Restricting participation in sports 
and other extracurricular activities 
to only those with passing grades? 

Agree 77% 

Disagree 19% 

Don't know/Refused 4% 



Raising teacher^s pay? 

Agree 81% 

Disagree 12% 

Don't know/Refused 7% 



Increasing standards to pass 
courses and graduate? 

Agree 84% 

Disagree 10% 

Don't know/Refused 6% 



91 



1987 

In 1984, the Texas legislature 
passed a major reform bill. I will 
name several of the major reform 
measures and ask you to say whetlier 
the measure significantly improved 
public education, slightly improved 
education, had no eflfect, had a sliglit 
negative effect or a significantly 
negative effect on public education. 

BLestricting participation in sports 
and other extracurricular activities 
to only those with passing grades. 

Significantly improved 32% 

Slightly improved 41% 

No effect 7% 

Slight negative effect 10% 

Significant negative effect 3% 

Don't know/Refused 7% 

Raising teacher^s pay. 

Significantly improved 25% 

Slightly improved 38% 

No effect 22% 

Slight negative effect 4% 

Significant negative effect 1% 

Don't know/Paused 10% 

Increasing standards to graduate. 

Signi£cantly improved 34% 

Slightly improved 42% 

No effect 10% 

Slight negative effect 4% 

Significant negative effect 1% 

Don't know/Refused 9% 
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Table 8.1 

1986 

Requiring students to pass 
statewide standardized tests? 

Agree 72% 

Disagree 21% 

Don't know/Refused 7% 



Increasing sales tax to provide? 
greater state funding for schools 

Agree 69% 

Disagree 26% 

Don't know/Refused 5% 



Competency testing for teachers 

Agree 79% 

Disagree 17% 

Don't know/Refused 4% 



Continued 
1987 

Requiring students to pass 
statewide standardized tests. 

Significantly improved 29Vf 

Slightly improved 399» 

No effect 12^/ 

Slight negative effect 69f 

Significant negative effect 2^ 

Don't know/Refused 12^ 

Increasing sales tax to provide 
greater state funding of school 
districts. 

Significantly improved ]7% 

Slightly improved 339( 

No effect 24% 

Slight negative effect S% 

Significant negative effect 2% 

Don't know/Refused 16%, 

Competency testing for teachers, 
already in the classroom 

Significantly improved 26%, 

Slightly improved 30% 

No effect 15% 

Slight negative effect 13% 

Significant negative effect 6% 

Don't know/Refused 10% 
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pass, no play"" reform withstood the test of time. In 1986, 77% of Texas citizens said 
that they agreed with the "no pass, no play" restriction and, in 1987, 73% of Texans 
said this measure had worked to improve education. Placing grade restrictions on 
extracurricidar activities had always been one of the most popular but controver- 
sial reforms. Although it had very high endorsements in positive surveys ("Do you 
favor no pass, no play: ), it also elicited the the strongest negative response when a 
random sample of citizens had been asked to name any educational reform to which 
they were strongly opposed. In 1985, seven percent said they strongly opposed 
grade restrictions on extractirricular activities while only 2% objected to compe- 
tency testing for teachers (The Texas PoU, 2(1), 1985). The other reform which 
appeared to maintain its same level of public support over time was competency 
testing for students, dropping only four percentage points. Increasing standards 
to graduate had the highest level of support in 1986 and, despite losing eight per- 
centage points, continued to be seen in 1987 as the most effective of all the reform 
measures named. A pervasive but subtle indicator of the public's disenchantment 
with all reforms was the consistent increase in don't know responses from 1986 to 
1987. It was apparently more difficult to say whether a measure had been effective 
than to support the intention of a reform. 

In 1986 the least popular reform by a slight margin was increasing the sales 
tax to redistribute state funds to poor school districts. In 1987 it was again the 
least popular but had also lost substantially in its absolute level of support. In 
1986, 69% had agreed with the sales tax increase but in 1987 only 50% believed the 
increase had improved public education. Similarly, raising teacher's pay dropped 
from 81% support tc 63%. 

The reform measvure that sustained the very largest drop in public endorse- 
ment was competency testing for teachers. Questioned before the testing took place, 
79% of Texas citizens favored testing teachers. Asked in the sununer of 1987, only 
56% of Texans said that competency testing for teachers had improved education, 
reflecting a decline of 23 percentage points. Some of the loss of support over this 
period might be attributed to a change in the imderstanding of what competency 
testing would be. When the 1986 data were collected in late 1985, teacher testing 
was still intended to be both TECAT and subsequent subject matter examinations. 
Although TECAT was omnipresent in the news at the tiine of the earher survey 
(see Section 3), some well-informed respondents could have had the more extended 
conception of competency testing in mind when they answered the question. The 
1987 questions asked respondents to judge the efficacy of reforms as implemented. 
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Thus, whether or not the Texas legislature had subsequently rescinded subject- 
matter testing, judged effects on public education would have to be based on the 
implementation of TECAT. To a certain extent, all of the question comparisons 
reflect a difference between the rhetoric of intentions and the realities of actual im- 
plementation. One way to interpret the large drop in public support for teacher 
testing is that it was the reform that least Uved up to expectations. 

Follow-up questions were used to probe respondents" reasons for thinking 
that teacher testing had improved education, had had no effect, or had had a neg- 
ative effect on education. Positive and negative answers tended to parallel very 
closely the two categories of tesurher responses described earlier. Supporters reit- 
erated the original intention of the measure: "it weeded out bad teachers" (20%), 
" it made teachers keep up to date" (11%), and, more generally, "it improved the 
quality of education" (12%). Those who said the measure had no effect or a neg- 
ative effect explained that, "it had insulted and angered teachers" (16%), "it wa^ 
not a fair measure and not a test of ability to teach" (7%), and that "there were 
problems with the test format" (4%). Twelve percent of respondents gave individ- 
ual explanations that did not fit these global categories: in addition to the 10% who 
answered "don't know" to the teacher testing question, 8% more did not have an 
answer to the open-ended question, residting in a total nonresponse rate of 18%. 

Clearlj^ a large segment of Texas citizens lost faith in teacher testing after the 
implementation of TECAT. Although all of the reforms lost a little from promises to 
implementation, competency testing for teachers lost the most, falling to the same 
low level of endorsement as redistribution taxes. Because the public continued to 
endorse some reforms at a high level, including pupil testing, respondents were 
clearly differentiating between reforms they believe to be effective and ineffective 
rather than reflexively responding negatively after the initial enthusiasm had worn 
off. Teacher concerns that TECAT may have harmed public opinion have some 
support from the representative survey. Although about half of the teachers and half 
of the citizens sai<^ that TECAT was effective, the numbers expected for a ringing 
endorsement would be much higher. By convincing only half of Texas citizens, the 
TECAT failed at one of its major piuposes, to reassure the public about the quality 
of education. 
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Section 9: COST ANALYSIS 



How much did it cost to test every current teacher and administrator in 
Texas? The contracted cost was $4,833,000 in special funds to develop the TECAT, 
administer it and score it. In addition, the Texis Education Agency subsidized the 
appropriation by assigning tegular assessment staff to the project for an estimated 
cost of $232,500. 

The largest cost of the test administration was in teacher time. School was 
cancelled on TECAT Monday so that teachers could take the test. Schools absorbed 
this cost by using one of the teachers' regular inservice days. Based on average salary 
figures, teachers cost $131 per day. Counting only the number who actually took 
the test, the cost of teacher test-taking time to local school districts was over $26 
million. Local districts also provided test sites for each of the test dates. For most 
districts this meant providing a janitor and utilities from early in the morning to 
late at night. A few urban districts also had to maintain security staiF during testing 
hours. Based on estimates, the total cost of providing local test sites was $138,500. 

In Table 9.1 we have also approximated, in very rough terms, the publicly 
sponsored costs of providing inservice preparation for the test. The activities in- 
volved are based on our interviews with personnel directors, staff of the Education 
Service Centers, vmion leaders, and teachers. Estimates used to determine the 
niunber of teachers taking formal review courses were derived from the teacher in- 
terviews. Roughly, the number of teachers who had no formal preparation was 
offset by the number who participated in two, three, or more days of review. Thus, 
approximately 200,000 "teacher equivalents" attended woikshops at an average cost 
of $30 per session; the cost for review has been divided, however, between public 
and private expenses because of differences in district policies about who paid. In 
addition, even if they did not pay for workshops directly, all districts spent staff 
time in keeping teachers informed about study opportunities or in arranging work- 
shops for which fees were collected; to these efforts we added the extensive staff 
investments from the 20 Service Centers to arrive at a baseline administrative cost 
for the review function of $5 per teacher. Thus a district with only 100 teachers was 
assumed to have devoted at least 20 hours of administrative time to support services 
for the TECAT. Lastly, we added the cost of providing sites for review workshops 
since most districts either conducted their own workshops or at least provided the 
facilities for contracted -.vorkshops. 

When the cost of publicly supported review sessions is included, the total 
tax-supported cost of TECAT was 35.5 million dollars. The analysis summprized in 
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Table 9.1 
Summary of TEC AT Cost Analysis 



PUBLIC COST 

Test development and administration: 

Nominal cost $ 4,833,000 

TEA Staff 232,500 
Teachers' inservice day to t£ike the test 26,260,000 
(202,000 teachers x i 130/day) 
Preparation workshops and review: Costs 
to districts and Education Service Centers 

Inservice development or district paid-for 3,000,000 

workshops. (100,000 teachers x $30) 
Information services and staff time 1,050,000 

(210,000 teachers x $5) 
Sites for workshops 100,000 
(800 site days x $125/site) 
Total Public Cost $ 35,614,000 



PRIVATE TEACHER COST 

Workshops paid for by teachers $ 3,000,000 

(100,000 teachers x $30) 

Materials purchased by teachers 300,000 

(20,000 teachers x $15) 

Teacher study time 39,552,000 

(206,000 teachers x 12 hrs x $16/hr) 

Teacher-paid-for score reports 300,000 

(20,000 teachers x $15) 

Total Private Cost $ 43,152,000 



TOTAL PUBLIC & PRIVATE COSTS $ 78,766,000 
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Table 9.1 should be considered conservative in that costs were only included if there 
v/ere data to support the estimate. Additional costs very likely occurred without 
our being able to represent tnem in the analysis. 

Realistic cost data are important, however crudely estimated, because ac- 
tual costs were an order of magnitude greater than the anticipated cost of testing. 
TECAT was expected to cost about $3 million. This was the number found in 
the cost estimates of the Select Committee and was stil! the figure used when the 
State Board discussed the feasibility of implementing the legislation by testing every 
teacher with a Texas- developed test. In most cases SCOPE staff and staff of the 
Comptroller who computed cost estimates for proposed reforms included increases 
for both state and local jurisdictions. This was not done, however, in the case of 
teacher testing. A one-time test for practicing teachers was considered to be one of 
the cheapest of all the likely reforms. We have included as Table 9.2 a portion of the 
cost analysis which accompanied the Select Committee recommendations. Data on 
the real pubhc cost of TECAT indicate that it was an expense more on the order of 
a programmatic intervention such as pre-kindergarten for disadvantaged four year 
olds, rather than an inexpensive item fitting within the error of the estimates for 
major reforms. 

Table 9.1 also includes an estimate of the private c->sts to teachers and ad- 
ministrators taking the test. Here we include the half of workshop costs that were 
not covered by public monies. We have also included lower-bound estimates of both 
teacher purchased study materials and score reports. (Teachers who failed a part of 
the TECAT were given diagnostic score reports free by the test contractor; but, if 
teachers who passed wanted to know the details of how they did, they had to pay.) 

In the analysis of private costs, again the single largest item is teacher time. 
On average, teachers and administrators spent about 12 hours studying for the 
TECAT (with a range of 0 to 100 hours). At an average hourly rate of $16, we can 
assign a dollar figure of $39,552,000 to the time contribution. Some policy makers 
might argue that this dollar amount is misleading since it did not involve an outlay 
of cash a^ did the other private costs. However, it is conventional in cost analyses 
of this type to try and compute a dollar cost to represent the opportunity cost 
implicit in a policy choice. In other words, when legislators mandated a test that 
could cause teachers to lose their jobs, they set in motion a series of consequences 
including the intense effort to prepare for the test. Another way to try to reoresent 
the opportunity cost woald be to imagine what would have happened if, instead, 
the legislature had required that each teacher in the state spend 14 hours tutoring 
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an individual pupil. Thus 210,000 pupils would each receive 14 hours of individual 
tutoring. (We arrived at 14 hours as the sum of average study and test taking 
times.) Prom meta-analyses of the research literature on tutoring (Hartly, 1977) 
we can conclude that the average benefit from 36 hour tutoring programs is .54 
sta. ^ deviations; therefore, 14 hours of tutoring might produce a .21 standard 
deviation effect. Although 210,000 pupils are a small niunber in a state of over three 
million pupils, the personal contact and achievement gains for these students could 
be considered a signifi'-.ant educational effect. The administration of the TEC AT 
in Texas was a phenomenal educational intervention. It is appropriate to interpret 
results in terms of costs and to ask what might have happened if the same investment 
of resources and energy had been spent in another way. Taken together the public 
cost of the TECAT ($35,614,000) and the private cost to individual teachers and 
administrators ($43,152,000) amoimted to more than 78 million dollars. 

When TEA assessment staif were invited to review our preliminary findings 
they noted that our estimates of the pubUc cost of TECAT were credible. The 
Commissioner and TEA staff did not believe, however, that our analysis had given 
sufficient credit to the benefits of the testing program. Especially where we had 
emphasized the public and private cobts of TECAT, it would be worthwhile to 
assign a dollar value to the public funds saved by firing incompetent teachers. 

To accomplish this analysis, TEA provided detailed informal-ion about the 
job assignments of the 1,950 educators v:ho were removed from the system by 
TECAT; these individuals either failed twice or left education after failing once. 
Following arguments made earlier, we were imwilling to count as succ**sses of the 
program removal of vocational educators, special education teachers, staff at group 
homes, p.e. teachers, or kindergarten teachers. The data confirmed that these 
groups were over represented among the failures. But TEA staff argued com- 
pellingly that many of the failures held mainline teaching jobs and were directly 
responsible for the academic preparation of students. Given the low level of their 
own skills, it is hard to beUeve that they could do a good job in teaching basic 
skills to students. For example, 383 of the failures were regular elementary school 
teachers; 22 failures were even secondary school English teachers. 

In Table 9.3 the teaching assignments of eUminated personnel are classified 
as academic or nonacademic. Math and science teachers were counted as academic 
assignments, so were history, government, and foreign language teachers; some of 
these individuals might also have been coaches but we were in^'erested in their 
qualifications to teach the academic classes they had been assigned. In addition 
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to physical education aiid industrial arts, we classified music, art, ESL, and health 
as nonacademic assignments. Some categori?;ations were more difficult to make 
and were somewhat arbitrary. We counted failed principals and superintendents 
(administrators ai = 66) as academic assignments and hence "successes" for the 
program; certificated personnel at TEA, at regional service centers, and at state 
homes were coimted as nonacademic since they do not have academic responsibilities 
with children. The IS librarians who failed were counted as academic but the 22 
counselors who failed were counted as nonacademic. 

The individuals who had been removed by TECAT were divided thusly into a 
total of 887 academic jobs versus 1063 nonacademic jobs. The 887 firings represent 
the intent of the testing program, i.e., to remove incompetent teachers from the 
classroom. The average salary paid to all certificated personnel in Texas in 1985-86 
was $23,765. If this amount is incremented by 20% to allow for benefits, then it 
could be said that the annual cost of these 887 incompetent teachers is over $25 
million. As a result of TECAT, this amount of taxpayer dollars will no longer 
be wasted, and hence is i savings which compensates for the public expenditure 
on the test. Furthermore, to program advocates, the firings represent recurring 
savings (less so as retirements and normal attrition would occur); but TECAT was 
a one-time expense. 
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Table 9.3 

Academic and Non-Academic Teaching Assignments 
of Teachers who Failed TECAT Twice 
(or Who Failed Once and Did Not Retake) 

(n = 1950) 



Assignment 
KINDERGARTEN 
ELEIvIENlARY 
Generic 

Physical & Life Science 

Mathematics 

Music & Art 

ESL 

Reading 
English 

Geography & History 

Spanish 

Health 

Physical Education 
Other and 

Missing data proportionally assigned 
SECONDARY 
Generic 

Biology & Life Science 

Chemistry, Physical h Earth Sci. 

Mathematics 

Music & Art 

ROTC 

ESL 

English 

Speech and Reading 

Econ., Geog., Government & History 

French & Spanish 

Computer Science 

Industrial Arts, Trades & Homemaking 
Business Education 



Academic Non-Academic 

107 

383 
2 
10 



31 
1 
8 
1 



53 

12 
19 
39 
71 



22 
15 
64 
8 
5 



15 
12 



10 
66 

36 



17 
5 
5 



31 
10 
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Health 19 
Physical Education 88 
Other and 

Missing data proportionally assigned 30 57 

ALL LEVEL 10 
ITINERANT 1 
PREKINDERGARTEN 14 
AIDE 2 
VOCATIONAL EDUCATION 308 
SPECIAL EDUCATION 191 
SUPERVISOR 2 
ADMINISTRATORS 66 
COUNSELOR 22 
VISITING TEACHER 7 
SCHOOL NURSE 6 
LIBRARIAN 18 
Other and 

Missing data proportionally assigned 8 21 

NON PUBLIC SCHOOLS 22 

Includes TEA, Univerpity and Service 

Center Staff, and Staff of State 

Schools and Groups Homes 
TOTAL 887 1063 
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Section 10: COMMENTARY 



The Texas Examination of Current Administrators and Teachers, the TECAT, 
was one of a long list of educational reforms designed to improve education. Specif- 
ically, it was intended to weed out the few incompetent teachers in Texas, thus 
assuring the public that the remaining cadre of teachers was worthy of higher pay. 

To imderstand the particular natiu*e of the Texas situation one should realize 
that the TECAT was a basic literacy test with harsh consequences. Although 
frequently called a competency test, the TECAT was more accurately a measure 
of pre-college reading and writing skills. Every current teacher and administrator 
would have two chances to pass the test in the Spring of 1986; if they failed they 
would be out of a job in September. 

When we tried to evaluate the effects of the teacher test we were confronted 
by contradictions. For example, the TECAT constuned the attention of educa- 
tors for a year, yet in the end had little impact on staffing. Half of the teachers 
in the state experienced enough anxiety cr devoted so much time to studying for 
the TECAT that they believed their teaching was swiversely affected; many more 
teachers felt that the test had had a demoralizing effect on themselves and their 
colleagues. Ultimately, 99% of the teachers passed. Thus, when interviewed in the 
Fall of 1986, most personnel directors had not experienced much disruption. Many 
had had no teachers fail or had dealt with the handful of teachers who had to be 
replaced. Even in the very largest districts where a tiny percent was still over one 
hundred teachers, normal recruitment and alternative certification programs filled 
the vacancies. The Commissioner of Education had made it cleai that requests for 
waivers would be severely scrutinized; therefore the majority of districts did not ap- 
ply for waivers on behalf of their teachers who failed. Some foun<! non-instructional 
posts for those they wanted to keep; others adopted temporary measures and waited 
for the third retesting in October. 

A second conundrimi or irony was created by two competing conclusions: 1. 
Many teachers who passed the TECAT continued to exhibit the kinds of language 
errors that originally incensed legislators, and 2. Many of those who ^Jled and 
were not rehired were regrettable losses to the system. All tests are fallible and will 
produce some classification errors. Of course, those who passed TECAT because 
of measurement error, perhaps 4,000-5,000, were not identifiable and did not have 
to retake the test. In addition, in review sessions all over the state, many teachers 
learned the tricks of the multiple-choice questions, especially in TECAT where a 
pattern of "wrong" alternatives would occur for every type of question. Thus many 

102 



ERLC 



teachers raised their scores on the test without mastering the skills the test was 
intended to measure. In written responses to our questionnaires we saw some of 
the same bad English that had appalled legislators. For example, more than a half- 
dozen tesurhers said that TECAT lowered teacher "moral." One teacher wrote that 
the reason for the test was to "help the public except a pay raise." Another said 
he would go into "bussiness" if he failed. However, we are reasonably certain that 
all of these teachers passed TECAT because they made only one or two errors of 
this type on a two-page questionnaire. By the scoring rules for the TECAT these 
isolated errors would not be sufficient to fail the paper. And, we concur that these 
papers(questionnaires) were quite literate in other respects. Thus, policy makers 
need to accept the basic premise of a minimalist test. If you are going to deny a 
person their livelihood on the basis of a test, errors have to be fairly egregious before 
they me. *t flimking. Large numbers of individuals with marginal literacy skills will 
pass. 

At the same time that some illiterate teachers sneak past the test, some 
teachers with badly needed skills fall by the way. Disproportionately high failure 
rates were reported for minorities especially blacks, for special education teachers 
and the staffs of group homes, for p.e. tesichers and coaches, and for vocational 
education teachers (who did not have to have college degrees m the first place). 
It is important for policy makers to realize that TECAT did not single out the 
unprepared, indifferent, inexpert teachers they had in mind when they envisioned 
the test. (TECAT did not measiu^e these things.) Instead it "got" 20% of the 
staffs who worked with the institutionalized mentally rotarded and emotionally 
disturbed. It "got" shop teachers who have been teadung for 20 years and use 
grammar such as "he don't." The test also eliminated minority teachers, especially 
in areas with high concentrations of minority students. Surely, in some of these 
cases TECAT eliminated minority teachers who were better at teaching than at 
reading and writing standard English. 

A third "contradiction" observed in our study was the discrepancy between 
the cost and benefit of the testing program. Primarily TECAT eliminated 1,199 
teachers with some of the worst grammar skills. It may also have forced out another 
1,000-2,000 teachers who considered themselves at risk on the test. (Some teachers 
who left rather than take the test would have had no difficulty passing.) TECAT 
also had the effect of drawing approximately 180,000 teachers into review of rules 
of grammar. Only a small fraction of the teachers felt they had learned new skills 
from the review courses; but one- third thought their scores had been improved by 
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brushing up on things like punctuation and capitalization rules. (An even greater 
proportion felt their scores had been improved by learning the format of the test.) 
At least, a year of publicity surroundirg the TECAT probably sensitized teachers 
to use dictionaries when writing letters home to parents. 

The benefits of TECAT were achieved at enormous cost. The public costs of 
TECAT were conservatively estimated at $35,614,000. This translates into $29,703 
per failed teacher. Policy makers should also consider the opportunity cost of both 
the public and private investments in the testing program. The private cost, in 
terms of workshops paid for by teachers and teacher study time, was even greater 
than the public cost. What might have happened if this intensity had been focussed 
on some other educational problem? For example, in our cost analysis, we suggested 
that substantial achievement test gains would have been realized if each teacher in 
Texas had devoted just 14 hours to tutoring an individual pupil. 

Program advocates believe that the public costs of TECAT were offset by 
the benefit of having eliminated incompetent teachexs fi"om the ystem. For the 
failed teachers with academic jobs, we computed a savings of over $25 million. 
Furthermore, avoiding the waste of these dollars on incompetent teachers is an an- 
nual savings that will repeat (until normal retirements or resignations would have 
occurred). \/e did not attempt to ascribe a monetary cost, either public or per- 
sonal, to the losses incurred by the disproportionate firings of minority teachers 
and nonacademic personnel. Some would argue that these were not losses at ail; 
some would say that the few losses were worth the gains already mentioned. Dis- 
agreements about the meaning of these firings involve fimdamentally different value 
perspectives that are not illuminated by cost analysis. In addition, one's willingness 
to risk firing nonacademic personnel in the course of removing low skilled academic 
teachers is further confounded by varying degrees of confidence in what the test 
measures. In any case, these choices pose a dilemma. 

A final contradiction involves the harm done to public opinion about educa- 
tion and the esteem of the teaching profession. In Select Committee hearings, long 
before the first legislation was drafted, key policy makers lamented that education 
was not drawing would-be teachers from the top ranks of college graduates. In fact, 
the test was designed to get rid of teachers who were among the least qualified of 
college graduates. Now, the great majority of teachers in Texas believe that the 
TECAT stcted to demean the teaching profession because it was a basic skills test 
rather than a measure of their professional competence. Half of the teachers inter- 
viewed said that the test actually worsened public opinion about the competence of 
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teachers because of derogatory publicity, especially media presentations of very easy 
test questions. "Why are teachers making such a fuss? Anyone could do that." Be- 
fore the test, publicity increased public awareness of incompetent teachers tuat had 
managed to survive in the system. After the test, the 99% passing rate did little to 
assiu-e the public that incompetent teachers had been eliminated. Half of the teach- 
ers interviewed believed that the public had been disillusioned. They felt personally 
embarrassed by the portrayal of their profession and they feared that teaching was 
now even less desirable a career choice for a yoimg college student. Indeed, public 
opinion data compared over time showed greater disenchantment with teacher com- 
petency testing than with any other educational reform measure. Ironically, then, 
the TECAT may have had an influence exactly opposite that intended. Negative 
images associated with the test may discourage the brightest college students from 
aspiring to become public school teachers. 

The TECAT seemed so simple at first; give a test and eliminate the few 
teachers with indefensibly weak conununication skills. The negative side to what 
happened involves unforeseen consequences: enormou' cost, frenetic preparation 
and worrying about the test, demoralized teachers, and a public unimpressed by 
the extremely high pass rate. Although these outcomes were not intended, they 
may be inevitable features of a reform that hangs so much importance on a test 
pitched to the lowest level of performance on the lowest of teaching skills. 
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Appendix A 

CHRONOLOGY OF EDUCATIONAL REFORM IN TEXAS 
(Extracted from newspapers and documents 
as background to interviews.) 

1981: The legislature passed S. B. 50 requiring that persons seeking 

educator certification in Texas pass comprehensive examinations. 
The State Board mandated the development of the EXCET tests, 
Examination for the Certification of Educators in Texas. After 
February 1. 1986, all candidates for initial teacher certification 
must pass both a professional development test and a content 
specialization test. S. B. 50 also required that a basic 
skills test be given to screen students entering teacher 
preparation programs. 

1981: H. B. 246 authorized curriculum reform. 

1982: The State Board of Education adopted the Pre-Professional Skills 

Test (PPST) published by Educational Testing Ser/ice as the basic 

skills screening measure for admission into teacher education 

programs. (Implementation of S.B. 50.) 
January 27, 1983: In his first address to a joint session of the Legislature, 

Governor Mark White called for at least a 24 percent "^emergency" 

pay raise for teachers. 
April 26, 1983: A Nation at Risk: The Imperative for Educational Reform 

was released by the National Commission on Excellence in Education. 
May 30, 1983: The Legislature adjourned without action on White's tax 

proposals but with agreement to appoint a blue-ribbon study panel. 
June 16, 1983: Governor White named Dallas businessman, H. Ross Perot, 

to chair the Select Committee on Public Education. 
July 8, 1983: Results of PPST pilot test released. One-third of T^xas 

college student prospective teachers failed; 80% of blacks failed, 60% 

of Hispanics failed, and 15% of Anglos failed. 
April 19, 1984: Perot's committee released its final report calling for 

sweeping changes in public education. 
June 4, 1984: Legislature convened a special 30-day session to consider 

White's program for school reforms and highway improvements and 

the tax increase needed to finance them. 
June 30, 1984: Legislature passed education reform package including 
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July 3, 1984: 
January 9, 1985: 



February 1, 1985: 

February 1985: 

June 7, 1985: 
August 29, 1985: 



December 7, 1985: 
January 10, 1986: 
February 7, 1986: 



March 3, 1986: 
March 10, 1986: 

May 10, 1986: 

June 26, 1986: 



competency testing for practicing teachers. 

Legislature passed $4.6 billion tax package. 

John Sharp introduced S. B. 103 to exempt teachers who 

had passed some other standar'^ized test. His bill received little 

support. 

Special advisory committee made up of testing experts recommended 

to TEA that all teachers without exception take a basic compeic-icy 

test. Commissioner Kirby estimated that it would cost $3 million. 

State Board of Education announces recommendation to postpone 

subject specific exams. Basic literacy test is expected to catch 

85-90% of incompetents ana will save the state $17 million. 

State Board of Education completes arrangements for 

teacher test in March of 1986. 

Texas State Teachers Association filed suit claiming 

that the testing of practicing teachers violates lifetime teaching 

certificates and the prohibition in the state constitution against 

retroactive laws. 

The State Board of Education exempted Houston 
teachers from TECAT because they take F.A.S.T. 
The State Board of Education set the test cutoff 
score at 75%. 

The Association of Texas Professional Educators filed 
suit to bar districts from firing based on first exam. Forth Worth 
and other districts had stated that they ^vould fire teachers who 
failed the first time. 

Judge Harley Clark upheld the constitutionality of the test. 
The TECAT was administered to 202,084 practicing 
teachers and administrators. 

The results of the first TECAT administration were 

released to the State Board of Education. 

The second major administration of the TECAT wad given, 

the last chance for those who wished to teach in the Fall of 1986. 
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TEXAS TEACHER TEST INTERVIEW PROTOCOL: 
Public Figures Form 



Identification information, to be filled out in advance of 
Interview: 

Name Role 

Address 



phone. 



I am a member of a research team from the federally-funded 
Center for Student Testing, Evaluation, and Standards. Our 
particular project is focused on state testing programs that have 
been Implemented as an educational reform. 

I would like to ask you questions about the history and 
purpose of the Texas Teacher Test (the TECAT) • Think back to a 
time before much support for such a test had developed. What 
conditions in Texas made the desire for such a test arise? 



Here there important educational issues? 
(public/media perception of quality of educ.) 
(actual data on quality of education) 



.economic issues? 
(attracting high tech to Texas) 



Were there national trends or policies that 
contributed to the desire for the test in Texas? 



At the time were you aware of national 
reports on the status of education? Can 
you name them or their principal points? 



o 120 



What were the political issues that provided 
a basis of support for the Teacher Test? 



Can you recall key events leading specifically to the development 
of the testing legislation? 

(We have developed a chronology of events from official documents 
but are more interested in people's perceptions of key steps.) 



What were your reactions to the Teacher Test prior to the 
enactment of the legislation? 



What part did you play (if any) in the creation of (or opposition 
to) the legislation? 
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Now I'd like to step back for a moment from our exclusive focus 
on the lECAT. Cm you help me understand how the TECAT fit into 
the bigger pictUi. 3? Nhat other legislative changes were being 
made for educatic i? 



Has a test deemed essential from the start? 



What other alternatives were considered? Vfho 
offered the alternatives? 



Nhat were the competing viewpoints regarding the Teacher Test? 
(Characterize your view and that of the opposing side(s). Who 
were the principal spokespersons for each side?) 



After the idea of a test for practicing teachers emerged, how was 
this particular type of test decided upon? (Basic lite/acy vs. 
teaching skills or subject matter expertise) (What reasons or 
arguments were used in support of this type of test?) 



Nhat was the primary purpose of the test as 
it was finally formulated? 



He wish to describe public reaction to the legislation. 

What would you say was the reaction of various groups such as 

educators. . . 



the media. . • 



general citizenry... 
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minority groups. • • 



teachers' associations. • • 

Has the reaction of \ese groups changed as the test has been 
Inplemented? educat^ s... 

the media • • • 

general citizenry. . • 

minority groups... 

te^ zhers' associations. . • 



What Is your assessment of the effect of the testing program^ no 
far? 



Has the effect thus far been what you expected It to be? 
(Yes. . . ) 



(Surprises. . . ) 



Have there been any actions that you would do differently If you 
had It to do over again? 
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If you were to advise public officials In another state 
contemplating such a testr what would you tell the2n to do and not 
to do? 



(re: reform packager form of test^ test development. 
Implementation or administration r publicity. ) 



Have ny questions covered the Important Issues regarding the 
Texas Teacher Test? 

Hho are the key figures that we should try to contact during the 
course of our study? 



Are there any observations you wish to add? 
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Pracoded infer naL ion 

0 BS# Name Aadr e s c 



H Phone W Phone Age Sex L'trinic. 



TEACHER PHOrJE SUi^Vll'Y 



iMy name is . I am part at a ^^^se.=^rch Learn fcom rr.u 

University of Colorado. We nave a federal grant tu i^tudy 
testing programs around the country, whece a test was 
inbtituted as pat t oi t^ducational reform. The Te/a>:: TECAT j.^ 
one of the urograms we are studying. 

Your phone number was selected as part of a tepi: esenLative 
sample of certificated personncrl. We are 7cry anxious f:o 
collect teaeher opinions. ITiese opinions will :::e suinm-r^r izc.. i 
our report to legiblators in other states about the fios c.rA 
cons of teacher testing. 

Is this a good time for me to ask you about 10 minutes ot 
questions regarding the TECAT? Your responses will ce 
com idential. Of course, you may decline to answer a/.y of the 
questions. May I record your answers to my ques'ion^.- 



What graae you teach?^ 



What subject do you teach';\ 



3. How many years have you taught? 

4. Did you take the TECAT on Mar:;i 10? 



bia you stiidy for the "LTAT? Ca:"i you estimat.- r^./w r...^.: 

time you spent attending ' ^rmal review session:i oi 

workshops? (hrs.) And how much time did you o{ end 

studying on your own (including ^Mtching TV broadcasts ai 
home;? (hrs. ) 



b. Did studying for the TECAT help or was studying a waste 
time? 



IPS 



7. VMhat do you chin-i you ledtned, or what okill^ aid yov. 
improve^ as a result ot ycur study m/V 



6. Did preparing for the TECAT make you a better teachet? 
(Follow up or explanation. ) 



J. Did preparing for the TECAT have any negative erf-^ccs 
your teacning during the past year? If yes, please explali 



10. Tell me which of the following starenient.i are true fcc 
yuu: 

The test measured skills I wa^ i:aught in schoci and tha. 
I use in teaching. 

^The test measured 'Jkills T wa^j ta'^ght in school uu^ aun'c 

need to use in tjaching. 

_The test measured skills I was never taught in schooi. 



11. How important to t-^aching are the skills measured hy 'he 
TECAT? 



12. Were you nervous about taking the TECAT? If so, do you 

think your anxiety affected your performance on thu test? 
(Explain. ) 



13. Is the TECAT a fair test? (Follow up for specific 
examplL»s. ) 



® IPC 

ERIC ^ ^ 



It. Do you know any teachers who 

-decided not to cake the TECAT ac dll? hew many7 

-did not pass the first t:iine they tuok the test? 

many? 

-did not pass and decided not to try again? How 

many? 



15. Can you tell me in a general way what kinds of teachers 
failed the test? (One particular subject, particular age, zoyz, 
or ethnic group ^ good or bad teachers?) 



Did their difficulty with reading ot writirig skills 
ever show up in tneir teaching duties? 



Do they have outstanding strengths in cipher ar*-,*as thai 
compensate for limited reading and writing skills? 



16. What will teachers you know do if they do not pass the 
cest the seco.;d time? 



17. What do you believe was the legislature's puiposr in 
mandating a teacher test? 



18. If you were talking to legislators ia othei" jtateh, whai 
would you say are the good things ana bad things abouc havln^j a 
teacher test? 

CM (-) 



19. Are your opinions specifically about the TECAT or any kind 
of test for practicing teachers? 



IP? 



20. Would you be in tavor of a test for people jui;t Jcavi.ij 
college and starting to teach? 



21. What has been the effect of the testing procrram on 
teachurs? 



22. What has been the effect of the testing program on oublic 
opinion about education? 



23. Would you be willing to tell me ... did you pass ail o-,r:.. 
of the TECAT? 



ERLC 
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Appendix D 



PERSONNEL DIRECTORS TELEPHONE SURVEYO) 



District 



Phone 



Stratu m 
Respondent 



Title 



(Permission to record 



Number of teachers 



Number of administrators 



Median or Mean teacher salary 



No. of days /yea*.; 



!• Can you tell me In general terms what has been the Impact of 
the TECAT on your district? 



2. Prior to the administration of the first TECAT, what did the 
district do to tell teachers about the test? 



3. Do you know what percent of your certificated personnel 
took the the TECAT the first time it was administered? 



4. Are you aware of any teachers choosing to retire early rather than 
cake the TECAT? 



How did you come to know of these cases? 



ERIC 



1^9 



5. What other reasons might account for practicing teachers who did not 
sign up to take the TECAT? 



6. What was the initial pass rate for your district? 



7. Did you or your office interact with any failing candidates between 
the two testing dates? 



8. What was the final pass rate for your district? 



Were there differential passing rates 

By subject matter? 

By racial/ethnic group? 

By years of experience? 



9. Did the test help you fire any individuals that the district 
had previously desired to remove? (Explain) 



10. Did anyone who is regarded as a very good teacher fail the test? 
(Explain) 



11. Did you seek waivers for any teachers who failed? 
How many? 



(type of teacher in general terms:) 

subject matter 

# of years teaching 

sex 



ethnic groups 
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12. If a waiver was sought^ what 'evidence did you provide of teacher 
shortage? 



ERIC 



13, In general are you experiencing teacher shortages? For how long? 
How severe? In what categories of certification? 



14. How do you cope with shortages? 



Hire provisional? 

(Are these Individuals more or less qualified? In what respects?) 
Have larger classes? 
Move teachers around? 
15. Has the TECAT had an effect on teacher shortages? 



16. Were you granted the waivers you sought from the TEA? 

Yes No 

by type: 



131 



If you were to address yourself to legislators in other 
states^ what would you say are the pros and cons of 
teacher testingV 
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Viewpoints 



Sunday, September 11, 1983 3 G 



Changing Texas education system 

to be difficult 




MDf measure. 



By HL ROSS PEROT 

I HAVE been tnveUng across Texas for 
asvmi weeka^ vtttiaf school boards, 
SBperintandeata. prindpaljip teachers 
and partais. PacterBS ud impraBdons have 
emergied that I would like to shim with you. 
Theaa views are not nadlngs or reconunen- 
datiOBS of our conunittee^ 
By 
Texas' 

achievement is below av- 
erage in the United 
Sute& 

Yet the children en- 
tering our public school 
I system today will grow 
I up in a complex, rapidly 
changtttg world. They will live in the age of 
information, tlie age of techn->logy, and the 
age of the computer. Today's students will 
change work fields several times dnring 
their businasa careers and will require fre- 
quent reinining because of rq^ change. 

EDUCATO W HAS long lead times, H^Qie 
Texas sdiool system is completely restruc* 
tnred by September 19H it will produce the 
Oat college graduate in the year 2000. Hie 
goal of Texas' public schools should be to 
teach our children to think, and to adapt to 
rapid change. We should provide our ehil* 
dm with a classic education. 

While a daasic edmmtiott should include 
generous doses of math and sci ence , we- 
B&R avoid developing technotogical robots. 
Our young people must not confuse dau 
wttb wisdom. They will need to learn both 
multi-Ievel and abstract thinking. 

They must learn hismry and literature. 
As $d9l% our children will assume the 
leedership of the free, world. They will be 
engiged in intense intematlottal economic 

competitimL They iHU bevtibi nn^^ 
iiy f or our large national de bt 

Failure to return the public schools to 
high stand&da of lerming and achieve* 
ment win result in die cruelest form of seg* 
regatioQ for our disadvantaged and minor-, 
iqr cm^rin. They cannot atford private 
achooia. Their only chence for .<moces8ful 
y tidpetion aaadults in a complex, rapidly 

fcKJL Bgiag world wtu be to have a first-rate 

ii^BBiiaxattoa in the pttbUe schools. 



Today the United States ranks 
at the bottom of the - ^ 
industrialized world in terms 
of education achievement By 
any measure, Texas' 
performance is below average 
in the United States. 

Too little attentira is given to the aver- 
age and above^verage student Too Uttie at- 
tention is paid to gifted and talented stu- 
djmttaaoss the state. They are our future 
taxpayers. It is important they be extremely 
go^ticttve. Th^ wiu bear tiie responsibU- 
tty for caring for tiiose in our society who 
cannot support tiiemselvei 

Discipline must be restored to the class- 
room. Learning cannot occur wltiiout or- 
der. . . 

. Edoeators across Texas are nearly unani- 
«ous in tiieir view that a chUd either 
learns how to learn or fails in the early pri* ' 
mary grades. Remedial work at tiie junior 

high and senior high level has a low probe. 
. bilityofsnccessL 

WTERBTWCLT enough, we spend more 
money per student in tire senior high level 
AU tile evidence indicates we should sur- 
round the small child wltii whatever re- 
sources are necessary so he can -learn to 
learn.- 



We should eliminate high school pn> 
grams whose real purpose is to allow stu- 
dents to leave school part-time to earn 
noneytopeyforcars. 

We should have vocational educational 
courses that train students on modem 
aquipment for Jobs tiiat exist 

Extracurricular activities should be pur 
in»penpective. They can no longer be the 

forces that disrupt our classes and dominate 
ourschoolSL 



We should consider eliminating orga« 
nized sports at the Junior high and elemen- 
tary school levels and subsatute physical 
fitness and intnmurals in their place. 
(Uany of our Junior high students lose e 
day and a half a week from learning as a 
result of organized sports) . 

IN SOME PRIMARY schools, sports have 
become highly organized, with games and 
other activities played at mght Children ar- 
rive at school the next day too tired to 
learn. Believe it or not in some places, we 
have elementary drill teams, cheerleaders 
andb& ontwirlers. 

I am told by educaton that many of these 
activities reflect the interests of the parents 
more than the children. 

Competent dedicated teachen are vital 
to the success of a public school system. Af- 
tcr meeting with educators from all areas of 
Texas, I am pleased to repon the quality of 
the administrators and teachers in our 
Texas public school system compares favor* 
ably with the people I deal with on a day-to- 
day basis in the business world. 

The range axid scope of problems faced 
by teachers and school administrators are 
. far greater than those faced by a typical 
businessman. A really bad day in the bust* 
ness world does not compare to a typical 
day in the public school system. 

The teachers axid administrators I have 
met have many reasons to be negative, and 
, yet I found them to be positive, constructive 
and dedicated to teaching our children. 
Tliey know what is wrong with public edu* 
catioiL They know what must ba done. They 
Twill be the architects and engineers of our 
' new Texas school system. 

Teaching is in transition. I. is becoming 
a profession. Under our new system of edu* 
cation, teachers will be held accounuble to 
high professional standards. The teachers 
of Texas welcome this challenge. At this mo> 
ment they are underpaid They are not prop> 
eriy recognized by the parents and commu- 
nity. 



This a difOctslt time tor tetcaen. A per* 
son with itnsitivt traits of a successful 
teacher finds it particttlarly offensive to be 
forced to fiirr^r' ptiblidy for proper com* 
pensation. Teachers should not have to 
m ^tea ^fWfiHg on their own behalf. Texas' 
oew educational system should properl]f 
compensate teachers on a continuing basis 
It should be supported by a tax structure 
that does not create periodic crises in Aus- 
tin. 

AT THE SAME time, teachen found to be 
or unqiaalifled should be removed 
from the profession. Tha schools of educa- 
tion that prepere future teachers are, with a 
few notable exceptions, doing a poor job. 



At another school district I asked the 
school superintendent, a former coach, 
about the balance between extracurricular 
and academic activitiei I asked, "Is the tail 




.nMmaoMatia af ariaeaiten « 

Correctinf this problem carries the 
highest priority. 

We must turn our schools into places of 
Iffpiitig There is only one real issue 
will tha pulAic support these changes? 

Public schoob reflect society. At a time 
when pleasnre ieeking and instant gratifi- 
cation are in vogue with both adults and 
children, and strong parental involvement 
with children is missing with roughly half 
of the 3 million children in our public_| 

schools* are wt going to ask our children to 
cut beck on video games, television, video 
music and cease leaving school early to 
make money to pay for cars? 

mil we ask them to work, toil and per- 
severe «- to take the difficult courses, not 
the soft electives—' to learn? This will be a , 
Mg change fic!n tha world of play our pub* 
lie schools have become in many places 
acroes the state. ': 

SCHOOLS REFLECT the public's interest > 
Across Texas, particularly in smaller com* 
munitias, the tax^ying public has a keen 
interest in tha band, drill team and athlet- 

WLile a classic education 
should include generoas doses 
of math and sdence^ we must 
avoid devdoping 
technological robots. 

These activities (»n^dd much of the lo- 
cal prtde and entertainment 

There is little stated interest in academic 
achievement As I talk with people in such 
communities, they arc aware of the need to 
change emphMis, but are concerned about 
public reactioa To quote one school board 
OMflaber, *'Oaa Thiriiffn^ people show up for 
Q *he Booster Qttb meeting* Three Show up at 
PR ^ members of the school 

t^jv>- mrd are elected by the Booster Club.** 




-wagging the dog?** He replied, Itoss, there 
is no dog left, but that is what the people 
want" 

For example, one school district gave a 
winning coach asalaiy greater than the su- 
perintendent The superintendent and prin- 
cipal then received salary increases to cor- 
rect this problem. At this point tiie district 
had exceeded its budget and teachers' sala- 
ries were cut to resolve the problem. 

In some school districts drill team mem- 
bers and band members must ygafn^'" a 
*V average to participate. Athletes must 
make only three *'D*s" and are allowed to 
fail all other courses, a policy set by the Uni- 
vertity Interscholastic League. Literally, 
the only defense on this policy for athletes 
has been ^ "If we didn't let these boys play - 
ball, they would be out on the streets com- 
mitting crimes.** One wonders what hap- 
pens to the girls on the drill team and stu* 
dents in the band who dont maintain a "B" 
average. Such policies clearly define the 
priorities of adults to studenti 

Courses are scheduled around extracur- 
ricular activities in some schools. Golf is 
practiced during the school day. Basketball 
and baseball, because of the number of 
^games played, take more timj from class 
*than football Four-H members are allowed 



by state law to miss class. Children from re- 
mote rural areas are out of school for sev- 
eraidaysatatime. 

EZnuCURRICULAR acitivities are im- 
portant In fact In many schools across 
Texas we demand excellence only in the 
band, drill team and on the athletic field. 
No one recommends eliminating these ac* 
tivities ^ Just putting them back into per* 
spective. 

Non<academic activities and electives 
that have littie learning value have taken 
over classroom hours. It is estimated that in 
the six hours our children are in class each 



day. less than 25 per cent of the time is 
spent learning. 

Education is expensive. Texas is now 
spending more than S8 billion a year on its 
public schools. Each year an additional S500 
million is required just to maintain the sta- 
tus quo. Education is the largest user of 
taxes in the state. Fifty cents out of every 
Texaa.tax. dollar goes 10 education. Thirty, 
cents goes to pubUc education and 29 cents, 
tiycottege^and univeTSities. * 

Texas has the largest school debt of any 
sttte. With our school population growing 
from 3 million students today to 4 5 million 
by the year 2000. we will inmr additional 
debt for facilities. We must be more cau* 
tious about building costs in the future 
than we have in the past 

Historically, our state income from all 
sources increased at about 15 per cent 
(This year tax income is Hat because of the 
reduction of oil and gas revenues in our 
state). Education expenditures in our state 
are increasing at a rate of 25 percent We 
cannot continue to support our education 
system as it is structured today. 

For years Texas has had so much wealth 
we could afford to buy virtually anything 
) we wanted. Much of our wealth has come 
from oil and gas. In the next 20-30 years, we 
will see declines in tax revenues from these 
resources. 

Texas has had a relatively small popula* 
tion supported by a large land mass. We 
now have 15 million people and will grow to 
22 million by the year 2000. Our minerals 
are being depleted. The balance between 
land and people is shifting. We are going to 
have to make hard decisions about our pub- 
lic schools for the first time. Our children 
will not be able to live off on abundance of 
mineral resources. They will have to live by 
their creativity, brains and wits as we de* 
velop a diversified industrial base to pro- 
vide Jobs for our people 

In a worid where our children must live 
by their brains and wits, what is our record 
of educational achievement? 

Today, the United States ranks at the bot* 
tom of the industrialized world in educa- 
tional achievement Texas students com- 
pared to other states are in the bottom half. 
For example, in the 20 states having mean- 
ingful SAT scores. Texas ranks "somewhere 
between 15 and 20." Our international com- 
petitors are preparing their children for the 
future, while we have allowed our schools 
to become places dedicated to play with soft 
elective courses that contribute little* to 
learning or success in life. ^ 

THE WORLD IS a tiny place. Our chil* 
dren will have to compete internationally. 
When we fail to compete and win. we lose 
jobs and reduce the tax base that allows us 
to fund education, the roods and other 
things our country and state need. We do 
not have a choice. We must learn to com- 
pete and win in intemanonal competition. 
At this point we are losmg. We have 
watched steel, television, parts of the elec- 
tronics industry, automobiles and other in- 
dustries decline or disappear to interna- 



tional compctitiotu Hundreds of tliousands 
of Jobs foratrly held by US. workers have 
been lost overseas. If we had kept our posi* 
tlon in these Indostrles, wt would not be 
incurring the huge deficits we now have at 
•the natj iial level Tlie tax base from the* 

Jobs would have been more than adequate 
to cover these deficits. 

Russia, as we enter the age of informa- 
tion, has S.000,000 students studying cal* 
cuius. The United States has only 500,00a 
Academic achievement is stressed. Russian' 
children go to school 240 days a year, six 
days a week, eight houn a day. (Our cHil* 
dren go to school approximately 180 days a 
year, five days a week, six hours per day). 

Japan, with no natural resources, a small ' 
land area and large populatien has become 
the most productive nation on earth. . A. 
school system stressing learning and aca- 
demic achievement was imposed by the 
United Stttes on Japan at the end of World 
War n. TUs education system is credited 
with much of Japan's current success. 

Japan, Western Europe and Russia are * 
different from the United States. Even so,' ' 
we must win in ecotunnic competition with 
these countries. Russia is a closed society. If 
we wish to keep our open, f^ society, we 
j * 

We should eliminate high ' 
school programs whose real . 
purpose is to allow students to ' 
leave school part-time to earn ^ [ 
tnoney to pay f or cars* 

must make the necessary, hard decisions, 
recognizing we are no longer wealthy 
enough to buy everything we want and wa 
must turn our schools into places of learn* 
ing and achievement 

foiBCraalwhr 



atH>aL«»gaitlnt hettar reailW^ Our com- 
minee is pursuing these questions. We will 
find the answers. j 
' There is no question about the love and' 
devotion Texans have for the children of . 
our sum. Perhaps the only real legacy we : 
can leave our children is to develop each 
child's mind to its full potentiaL 

Free people tend to ignore problems un- 
til a crisis materializes. This crisis is here^ 
We must act now for the benefit of our chil- ' 
dren. i 

The people of Texas need to consider . 
these issues thoughtfully and determine 
whether learning should be the dominant , 
force in our school system. 

There is only one real question What 
are our priorities? 

(If your reading skills allow you to fin- * 
ish this article, please pause to refiect that ' 
fiigny of our Texas high scha graduates do 
ruir^ hav« the vocabulary, reading skills or 
Ll\l v> mcentration to read such material). 




DoOm Morning N^wm: Paul KoUti 



These are excerpts from an articU wnf- 
ten for Viewpoints by H. Ross Perot, who is 
chairmm of the board of EUctronic Data 
Systems and chairman of the state's select 
committee on public educatiorL 



Viewpoints 



Editor . 



Rena Pederson 



Vicwpoims is a doUy forum for a wide varitty 
of views and opinions and does not necsssar- 
ily reflect th% tdHtonei opinion of The Dallas 
Mermng News^hona: 74S4259 
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AVERAGE CLASSROOM TEACHER 
SALARIES FOR TEXAS 



School Year 


Estlfflated Average Salary 
National Texas 


Texas ' 
Rank * 


Difference 


1982-83 


$20,531 


$19,549** 


25 


- $ 982 


1981-82 


$19,142 


$17,582 


28 


- $1,560- 


1980-81 


$17,602 


$15,728 


31 


- $1,874 


1979-80 


$15,966 


$14,132 


30 


- $1,834 


1978-79 


$15,057 


$13,042 


31 


- $2,015 


1977-78 


$14,247 


$12,534 


31 


- $1,713 


1976-77 


$13,357 


$11,564 


30 


- $1,793 


1975-76 


$12,600 


$11,342 


25 


- $1,258 


1974-75 


$11,647 


$ 9,807 


35 


- $1,840 


1973-74 


$10,778 


$ 8,920 


39 


- $1.8581. 


1972-73 


$10,164 


$ 8,686 


36 


- $1,478 


1971-72 


$ 9,705 


$ 8,462 


32 


- $1,243 


1970-71 


$ 9,269 


$ 8,147 


32 


- $1,122 


1969-70 


$ 8,635 


$ 7,277 


39 


- $1,358 


1968-69 


$ 7,952 


$ 6,625 


38 


- $1,327 


1967-68 


$ 7,423 


$ 6,576 


33 


- $ 847 



* Rank ai&ong 50 states. District of Columbia not included. 
** Texas Education Agency's estimate. NEA reported a weighted estimate of $19,500. 

SOURCE: Estimates of School Statistics , NEA 
and Rankings of the States , NEA 

TSTA Research 
April 29, 1983 



Appendix G 

COMMISSIONER KIRBY'S LETTER TO THE STATE BOARD ON TECAT STANDARDS 



January 10, 1986 



State Board of Education 
Austin, Texas 

Members of the Board: 



You are charged by statute with requiring satisf-ctorv 

examination prescribed by you as a conditio^ f!! !^ ^ per.-rmance on an 
each teache? and administrator iho has not taken r^h'T' '".'^ '^<^'^'^o- f« 

u I'Ac.TT''-' exa»in.?iSrorL;n" :rt?e":nd"";:::;rr:;u\";5 

iJet?iiir?jr-eI S^peV;;™"-: Z-i^s-ItisVact";. "^^"^ - - 

: I^rof^:b^?c^^^f^^^- r:i^u^ca^iorrou\Tbrtra::d°^to^\\e-ir 

there are some incompetent teachers and administrators currently in the 

eTu VtVr7-the:seUe:'' IT. ""'^'^ '=^^^"« prob i:^ c'L^ f^o^ 

educators in anv n^^^^^ "° '"""^ numerous incompetent 

w^flt ^ '"^V^.' "^"yo" individually could think of a few. So 

while the percentage of incompetent educators is predict I to be small the 
number IS significant statewide because of the 200.00o'memberc of the profeVsioS 

«a a group* 



The egislature came to the conclusion that the current system was not doing its 
job in purging from the profession those with inadequate skiUs to teacJ 
children appropriately. Consequently, the legislature charged this board witJ 
doing What the profession had failed to do for i?self. ?h.t in fac i. Vo.r; ^ 



dnriainn h« ► c iLoen.. inac in ract IS today's 

decision--to set a performance standard on a test that will identify chose 
individuals with insufficient skills to teach children appropriately 

i« i^*?-^".-'"*- 'u'^l contractors to provide an instrument that 

would between :hose who could read adequately and those who couU 

tested were b.'i - "7^ '""^^'^ " '"^^ be 

tJo.r who ; J"^": • The purpose of the test was to group people into 

those who had sufficient skills and those who did not. 

orskiVu."'iu. ™ t'T'"'/"-'"' test itself and to some of the specific types 
Hats and d'lt?"? t ""V ' '=^i°"«yj extracting facts from chart/and 
liM' "^.determination of the main idea in a paragraph. Certainly these are 

consfde'r A " """r"' '° ""P'"'' "ini™"™ level must be 

considered as you set the ultimate passing standard. 

staniaVd on llL'^'' J^ff"^"*' ^ recommending that the board set the passing 
s above 70Z S? sterns right out of 55. I realize that this standard 

correctly InsJer ?r ' graduates charged with teaching children can 

correctly answer 41 items out of 55 on a minimum skills reading test. 



ERIC 
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State Board of Education 
January 10 » 1986 



lltlrnJi "V"". composition ought to be scored by the 

• Iteroative more » ringent criteria and that the passing standard on the 

« ""'^"^ '^'^ '52. My Recommendations are 

based upon «y personal convictions that these standards are minim.' If f.IJ 

T:/r "n^r^ educational progress in this state, we simply cZ contViul tj 
n^«s^«;b«?c";.iU.-;'^"''^ in-truction by people^L do not\ave"%^: 

L7w•^^.^':^u^?tLl^'^"^"^•'• legislature not om. required 

that we test educators' abilities to read and write with sufficient skill to 

a^\7n\" r'a'tiJe^ti.r' ^" '''"^ .ub je^t'f i^ldl' aSd' 

!„!iif;^ fields. The subject area testing was deferred based upon a 

hat the hl^'rJV ''rrK^?" ''" "^^ 'he legisU^ure 

that the board believed the basic skills test would identify and remove the vast 

^Jv^cV'.h'*^'''•",^'"'*'T•^"•^• incapabl. of doing their job.. Based upon that 

ilfr , • • ^""u"''^^" i-plement.tion of the .ppr.is.l process 

wou d eli.in.te the m.jority of incompetent educ.tor. fro- the profession 

Aiff- !" 'i^ " « '-^"^ of competence ii "; 

difficult to underst.nd how .nyone could be . competent educ.tor Tf h.t persoS 

SeXL'r""''*'' ""'^"^ • re..onibLe [ev'e" of 

^i; rig^r.""- • ^- .PP "prrrte'/nd lit 

The bo.rd must m.ke the fin.l decision. In order to be .w.re of the likelv 

i.n"1o"%l"i:er'' h" 'S*n"" " " »t.nd.rd,%hich the bo.rd m' J 

w.nt to consider, the following ch.rt is provided: ^ 

Estiffl.ted F.ilure R.tes from 1986 TECAT 
Field Test D.ta for Selected Ccmbin.tions 



Option 
1 

2 

3 



Cut Score 
Reding & 
Writing 

6SZ 



70 Z 



752 



80Z 



83Z 



Writing 
St.nd.rd 

Current 
Altern.ti 

Current 
Altern.te 

Current 
Altern.te 

Current 
Altern.te 

Current 
Altern.te 



Field Test 
D.t. B.sis 

SZ 
8Z 

6X 

n 

10 Z 
12Z 

12Z 
ISZ 

20 Z 
22Z 



F.ilure R.te 



Anticipated* 

2Z 
3Z 

2Z 
4Z 

4Z 
5Z 

5Z 
6% 

az 

9X 



"f7.r.nc. in / L VV. ""J"'*" """^ ^'^^ both in M.rch .nd June. The 

c/r. ::::;::r,:r:?;:,;::" ^^-^ - -.ea upon .e e,pecte. 
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St«te Board of Education 
January 10, 1986 



In addition to the overall impact, the board must also consider the impact upon 
various ethnic groups. Comparable data to the composite data listed above is 
not available by ethnicity. However, a review of the field test data on the 
reading test at various cut off standards will give an indication of the 
potential impact: 



Projected Failure Rates for Ethnic Groups 
Reading Section « Field Test Data Only 



Failure Rate 



Cut Score 


Black 


Hispanic 


Ocher 


local 


65Z 


lOZ 


4Z 


IZ 


21 


702 


18Z 


6Z 


2Z 


4Z 


75X 


2SZ 


lOZ 


4Z 


7Z 


80Z 


38Z 


19Z 


7Z 


12Z 


85% 


S6Z 


36 Z 


16Z 


22Z 



Staff, contractor personnel, and I are available to assist the board as it 
ponders this mosc important decision. Please let me reiterate that I am 
confident that your decision will be the right decision because it will be based 
upon your collective wisdum. 

Respectfully submitted. 




W. N. Kirby 
Canmissioner of Education 
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1. KM USE TDAS BOUi HtS OUMUUmB) 



Ihe Texas Poll is based on 20 minute teleplvDne interviews with 
apprcscunately 1,000 adults around the state. The sanple is a random saxiple of 
telephone households in the state. 

The sample of telephone nunters called was selected from a conplete list 
of telephone exchanges in Texas. Ihe exchanges were chosen hy conputer to 
ensure that each region of the state was represented in proportion to its 
population. Within eacii exchange the sanple telephone numbers were fonned by 
randcn digits, thus permitting access to both listed and unlisted residential 
telephone numbers. Ihe sanpling nethcxSology is described in detsdl in the 
section 'Descr^Tticn of Sanpling Procedures'. 

In each telephone hous^ld contacted, one resided was selected randcndy 
for an interview. Several attespts were made to reach each telcrshone number 
and respondent. Interviews were onnducted in English or Spanish, depending on 
respondent preferenoe, by closely sqpervised professional interviewers. 

In 19 cases cut of 20, the results based on such sanples will differ no 
more than 3 percentage points in either direction from vtot would have been 
obtained by interviewing all adult Texans. Ihe error for sanaller grocps, 
e.g., Denocxats or coUege-eduoited persons, is larger. The sanpling errors 
asso c iated with different size stdsgrtx^ are l7y?tf>i in the section 
'i^jproximate Confidence Intervals for the 95% Confidence Level' . 

Readers should also be a^^are that the practical difficulties of 
conducting any survey of public cpLnion may introduoe other sources of error 
for vAiich prenise estimates c^jndt be cdlculatua. For exanple, different 
results n^ift -^ve bt-^ obtained from different question wording, and 
und etec tecf in i iz way the interviewing proced u res were carried out could 

have a sig. it effect on the findings. Good polling practices diminish 
the liJceliiw jf sot J-, errors, but they can never be entirely ruled out. It 
is also possojjle ttjat events occ ur r;"jig since the time the interviews were 
conducted could hs^re changed the opinions reported here. 

Bie Texas PoiLl is sponsored by Ifeirte-iJankes Ccramnications Inc. and 
c o n d uct ed by tlie Vublic Pjlicy Resooroes Laboratory at Texas ASM Universi**^ 
Die poll is diracted by Dr* James A. Dyer, senior stiody director of the Pl. lc 
Policy Rescuroes Laboratory .;t Texas A»I. Assisting Dyer in conducting and 
rqxarting the poll are Dave wayes and Kathy Oiqteel at the BryanKiDllege 
Station Eagle, a news^aaper owned by Harte-Han)cs Ccranonications, 




A quarterly, non-partisan survey of public opinion 

Conducted by Public Policy Resources Laboratory. Texas AAM University 



Sponsored by Harte-HanksCommiinications Inc. 



U. DKEE8 OP POIIi MD DISPOSZTIGM OF TBB SMSIE 



Sumer 1987 

The poll \;as conducted July 25 thrcu^ Aagiast 9. 

Ocnpleted interviews 1,000 

Refusads/Terminated interviews 253 

Total numbers reached 1,253 

Ocx3peration rate: 1,000/1,313 80% 

Final disposition of other calls:* 

Disconnected nunbers/continuous busy signed 617 

No answer** 225 

Reqxaident to be called back/ltespondent not avsdlable 20 

Business/GovemmenVCSiildren's Htione 145 

Deaf/Foreign language other than Spanish 16 

Total sanple 2,322 

* At least f cxir attenpts were made to reach each telephone nuinber or 
respondent. 

** Sane of the numbers classified as 'no answer' actually are disconnected 
nuntoers without a recorded aimouncanent to that effect. 
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HZ. CESCSZFIICll OP SMSUIC iWXK U UKm 



Qie sanple of telephone nuonbers is drawn by Surv^ Sanpling Inc. , Westport, 
Qomecticut^ and the following description of number selection is provided by 
them. 



SCRKTIFICAXIGN TD OOUNTIES 

To equalize the probability of telephone housdv^ld selection frcm anyvftiere in 
the area sanpled, sanples are first systonatically stratified to all counties 
in proportion to each ouunty ^s share or telephone households in the survey 
area. To obtain reasonable estimates of telephone housdx>lds by county, 
Survey Sanpling developed a special data base, beginning with 1980 census data 
for residential telephone incidence. Ihese counts, ipdated yearly with data 
on new telephone installations provided at the state level, are then allied 
to c ur r ent projections of household by county, published annually by Sales & 
Harlceting Managesent magazine. 

After a geogra^iiic area has been defined as a OGnbination of counties, the sum 
of estimated telephone housdiolds is calculated and divided by the desired 
sanple size to produce a sanpling interval. 

EKanple: 

(total estimated telephone hous^iolds) 750,000 

« 250 (interval) 

(desired sanple size) 6,000 



A random nuntoer is drawn between 0 and the interval (125) to establish a 
starting point. Assuming the starting point is 86, then the 86th, 211th, 
336th, 461st, etc. records v/ould be selected for the sanple, each time 
stepping thrcui^ the data base by a factor of 125. Ihis is a systematic 
random sample — as the sanple is selected in a systematic ^nth' fashion tram 
a random starting point. Any county vAiose population of estimated te l eph one 
nouseholds equals or exceeds the sanpling interval is automatically included 
in the sanple, yitdle smaller counties are included with a prcbabilty 
propo rtionate to their size. 

Using our exanple, the sanple size is 6,000, let us 2l1so assume that the 

geogr a phic area selected covers three counties. 

Dcaiple: 

The sanpling interval allows the proportionate distribution of the sanple 
over three counties as follows: 
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•total \ with 
Haiseholds Hions 

county A 223,404 94 
Ctxnty B 393,258 89 

Ocunty C 204,301 93 



820,963 





% Of 


Fhone Hausetolds 


Sanple 


210,000 


28.0 


350,000 


46.7 


190,000 


25.3 


750,000 


100.0 



SEIBCTrCN OF NUMBERS WTIHIN GOUKnES 



the sanple, one or more unique telephone nuniDers 
^ ^tenatic sanplang fron among all worldly blocks of numbers in 
all tel^toie exchanges assigned to the county. A workira block is defined as 
100 ocntiguous nunbers containing three or more residential tel^irane 



listings. 
Exanple: 

the phcme nunber 226-75i>o 
exchange block 



^ISL^i^n^ 'rS ^ exchange 226, the entire block ccnprises the 

Exchanges are assigned to a single county on the basis of 
Jf^if^i?^ about 80 percent of all exchar^ 

5 ^^^^'^^y For those overlapping county 

lines, the exciianges are assigned to the county with the highest rmbZ of 

listed residents. 



SEIECnON fMJtKi EXCHANGES 



Onoe tiie sai^e has been allocated, a second sai:p].ing interval is calculated 

S^lL'^^^.*^''^ ^ °^ tjl^iione households for the 

county by the pcrtion of the sanple allocated to that county. In our earlier 

ilJf^'^^f?^ °^ ^ (I'SSO numbers) would 

be drawnj&OT QMTty A. Each exchai^ and working block within an exchange 
are weighted by their share of listed telephone households. If the total 
?S°Sn°^.i^^ telefiione hous^lds in the data base for this county is 
159,600, then that nuntoer divided by 1,680 gives us an interval of 95. 

S^,'rJj^^^?lJ"-!?^ J*^^ ^ ^ exchanges and woricii^ blocks 

falling within the interval are saapled on a systematic basis. If a randan 

SSd S L^^ST*^' randonly chosen fron the rai«e 00-99 

^^^.^^^^K?^ °^ ^ Ihe result is a deplete 

S?f7??.;Sf the block, and the two randan digits (T^., 

2le^ In the case of a listed sanple, only listed houleholcs lA 
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sEUxmcN wrnuN icusehouss 



When a hous^ld is ocntacted, the interviewer asks to speak to the person 18 
years or older }A)o had the last birthday. Ihe exact wording of the selection 
question is: 

"In order to determine v*io to interview, oould you tell roe, of the people 
«ix> currently live in your hous^iold \iho are 18 or older — including 
yourself— had the most recent birthday?" Ask to speak to that person. 

If the person with the last birthday is not available, further calls will be 
made later to readi that person. Another person is not substituted. Ihis 
results in a random selection of respondents in the household. 



I 
» 
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IV. AFFR3XDaiE OOMFUZMCE IMEERyAIfi FOR TBZ 95% GOKFxDQO: IZVEL 

There are many possible sources of error in survey sanpling, indixiing 
noasureDent error, refusals, lack of ability to contact sane indivi duals , 
error due to sanpling from a larger population and so on. Error due to 
sanplirg fron a larger population can be ocnputed. The table below shows the 
sanpling error associated with different size grotps. The 'percent error' 
indicates the range around a value found in a sanple within yitilch the 
pqpulation value is likely to be found. For exanple, if we found that 30% of 
a sanple of 400 was R^.iblican, the error is \i*iich means that, 95 tiroes 

out of 100, sanples drawn the population would har/e between 25% and 35% 
Rqxiblicans. 



size ol grtxp 


Percent £] 


50 


V- 


14 


100 


+/- 


10 


150 


+/- 


8 


200 


V- 


7 


250 


+/- 


7 


300 


+/- 


6 


350 


V- 


6 


400 


V- 


5 


500 


+/- 


5 


600 


V- 


4 


800 


+/- 


4 


1000 


+/- 


3 
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